-- Logs begin at Thu 2022-05-26 14:15:55 UTC, end at Thu 2022-05-26 15:33:09 UTC. -- May 26 14:59:23.002416 dv-cinder-843018-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 26 14:59:23.011120 dv-cinder-843018-3-iscsi devstack@n-api.service[103359]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 26 14:59:23.013037 dv-cinder-843018-3-iscsi devstack@n-api.service[103359]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 14:59:23 2022] *** May 26 14:59:23.013037 dv-cinder-843018-3-iscsi devstack@n-api.service[103359]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 14:59:23.013037 dv-cinder-843018-3-iscsi devstack@n-api.service[103359]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 14:59:23.013037 dv-cinder-843018-3-iscsi devstack@n-api.service[103359]: nodename: dv-cinder-843018-3-iscsi May 26 14:59:23.013037 dv-cinder-843018-3-iscsi devstack@n-api.service[103359]: machine: x86_64 May 26 14:59:23.013037 dv-cinder-843018-3-iscsi devstack@n-api.service[103359]: clock source: unix May 26 14:59:23.013037 dv-cinder-843018-3-iscsi devstack@n-api.service[103359]: pcre jit disabled May 26 14:59:23.013037 dv-cinder-843018-3-iscsi devstack@n-api.service[103359]: detected number of CPU cores: 4 May 26 14:59:23.013037 dv-cinder-843018-3-iscsi devstack@n-api.service[103359]: current working directory: / May 26 14:59:23.013037 dv-cinder-843018-3-iscsi devstack@n-api.service[103359]: detected binary path: /usr/bin/uwsgi-core May 26 14:59:23.013788 dv-cinder-843018-3-iscsi devstack@n-api.service[103359]: your processes number limit is 47680 May 26 14:59:23.013788 dv-cinder-843018-3-iscsi devstack@n-api.service[103359]: your memory page size is 4096 bytes May 26 14:59:23.013788 dv-cinder-843018-3-iscsi devstack@n-api.service[103359]: detected max file descriptor number: 2048 May 26 14:59:23.013788 dv-cinder-843018-3-iscsi devstack@n-api.service[103359]: lock engine: pthread robust mutexes May 26 14:59:23.013788 dv-cinder-843018-3-iscsi devstack@n-api.service[103359]: thunder lock: enabled May 26 14:59:23.013788 dv-cinder-843018-3-iscsi devstack@n-api.service[103359]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 26 14:59:23.013788 dv-cinder-843018-3-iscsi devstack@n-api.service[103359]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 14:59:23.059476 dv-cinder-843018-3-iscsi devstack@n-api.service[103359]: Python main interpreter initialized at 0x5605d9a9a9c0 May 26 14:59:23.059476 dv-cinder-843018-3-iscsi devstack@n-api.service[103359]: python threads support enabled May 26 14:59:23.059476 dv-cinder-843018-3-iscsi devstack@n-api.service[103359]: your server socket listen backlog is limited to 100 connections May 26 14:59:23.059476 dv-cinder-843018-3-iscsi devstack@n-api.service[103359]: your mercy for graceful operations on workers is 90 seconds May 26 14:59:23.059814 dv-cinder-843018-3-iscsi devstack@n-api.service[103359]: mapped 403077 bytes (393 KB) for 2 cores May 26 14:59:23.059893 dv-cinder-843018-3-iscsi devstack@n-api.service[103359]: *** Operational MODE: preforking *** May 26 14:59:23.060160 dv-cinder-843018-3-iscsi devstack@n-api.service[103359]: *** uWSGI is running in multiple interpreter mode *** May 26 14:59:23.060160 dv-cinder-843018-3-iscsi devstack@n-api.service[103359]: spawned uWSGI master process (pid: 103359) May 26 14:59:23.060363 dv-cinder-843018-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 26 14:59:23.064554 dv-cinder-843018-3-iscsi devstack@n-api.service[103359]: spawned uWSGI worker 1 (pid: 103360, cores: 1) May 26 14:59:23.064554 dv-cinder-843018-3-iscsi devstack@n-api.service[103359]: spawned uWSGI worker 2 (pid: 103361, cores: 1) May 26 14:59:23.064554 dv-cinder-843018-3-iscsi devstack@n-api.service[103359]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 14:59:24.237305 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 14:59:24.238466 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 14:59:24.967454 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 14:59:24.967454 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: from cryptography.utils import int_from_bytes May 26 14:59:24.967731 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 14:59:24.967731 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: from cryptography.utils import int_from_bytes May 26 14:59:24.967852 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 14:59:24.967852 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: from cryptography.utils import int_from_bytes May 26 14:59:24.967983 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 14:59:24.967983 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: from cryptography.utils import int_from_bytes May 26 14:59:27.617976 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 14:59:27.618693 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 14:59:27.618811 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 14:59:27.619113 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 14:59:27.619375 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 14:59:27.619760 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 14:59:27.620141 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.620231 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 14:59:27.620311 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.620401 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.620534 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 14:59:27.620689 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.620898 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 14:59:27.621025 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.621136 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 14:59:27.621336 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.621522 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.621655 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.621847 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.622020 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.622170 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.622284 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.622491 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.622592 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.622818 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.622908 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.623152 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.623255 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843018-3-iscsi {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.623475 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.623573 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.623781 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.623889 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.624092 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.624197 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.624435 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.624535 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.624737 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.624843 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.625103 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843018-3-iscsi {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.625245 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.625426 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.625555 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.625738 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.626045 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.626148 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.626361 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.626476 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.626668 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.626786 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.626991 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.627140 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.627324 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.627515 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.627750 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.627939 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.628148 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.628326 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.628526 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.628730 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.628911 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.629101 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.629287 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.629476 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.629670 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.629868 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.630020 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843018-3-iscsi {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.630225 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.630421 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.630617 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.630798 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.630993 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.631194 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.631390 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.631390 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.631758 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.631946 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843018-3-iscsi {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.632106 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.632298 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.632435 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.632621 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.632752 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.632996 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.633128 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.633128 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.633432 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.633558 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.633705 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.633840 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.633972 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.634128 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.634254 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.634378 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.634501 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.634636 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.634761 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.634884 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.635035 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.635185 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.635319 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.635445 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.635567 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.635697 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.635826 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.635958 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.636090 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.636217 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.636341 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.636476 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.636606 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.636731 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.636863 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.636997 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.637121 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.637251 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.637387 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.637527 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.637683 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.637846 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.637972 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.638096 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.638219 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.638352 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.638479 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.638602 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.638732 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.638858 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.638989 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.639142 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.639269 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.639401 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.639526 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.639656 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.639793 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.640467 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.640602 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.640716 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.640820 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.640931 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.641185 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.641317 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.641517 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.641651 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.641807 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.641945 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.642116 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.642246 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.642425 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.642554 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.642734 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.642876 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.643117 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.643249 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.643450 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.643579 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.643743 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.643883 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.644018 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.644143 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.644292 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.644428 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.644608 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.644744 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.644928 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.645056 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.645237 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.645379 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.645538 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.645667 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.645841 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.645978 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.646157 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.646286 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.646472 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.646608 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.646771 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.646899 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.647035 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.647181 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.647329 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.647456 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.647625 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.647754 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.647943 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.648085 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.648290 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.648417 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.648541 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.648671 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.648820 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.648947 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.649118 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.649254 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.649419 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.649546 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.649723 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.649860 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.650028 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.650155 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.650331 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.650457 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.650636 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.650771 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.650937 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.651071 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.651267 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.651411 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.651572 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.651711 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.651877 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.652005 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.652186 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.652328 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.652495 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.652637 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.652799 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.652934 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.653142 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.653276 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.653410 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.653613 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.653754 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.653880 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.654005 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.654127 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.654285 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.654415 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.654589 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.654718 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.654893 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.655020 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.655284 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.655415 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.656207 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.656325 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.656588 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.656780 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.656922 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.657203 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.657333 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.657525 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.657656 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.657828 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.657976 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.658138 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.658275 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.658453 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.658583 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.658762 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.658902 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.659068 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.659230 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.659394 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.659531 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.659698 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.659837 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.660001 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.660131 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.660304 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.660435 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.660605 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.660756 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.660890 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.661022 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.661191 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.661320 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.661506 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.661647 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.661815 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.661944 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.662120 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.662256 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.662423 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.662551 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.662725 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.662852 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.663028 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.663211 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.663423 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.663561 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.663766 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.663893 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.664016 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.664139 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.664271 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.664408 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.664643 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.664773 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.664957 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.665099 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.665277 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:27.665406 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.665585 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.665726 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.665899 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.666038 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.666224 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.666353 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.666535 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.666678 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.666847 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.666989 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.667180 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.667311 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.667502 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.667632 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.667816 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.667946 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.668136 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.668264 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.668448 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.668583 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.668760 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.668896 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.669074 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.669215 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.669382 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.669519 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.669700 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.669917 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.670046 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.670177 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.670329 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.670463 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.670636 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.670767 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.670948 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.671235 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.671381 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.671509 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.671753 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.671928 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.672065 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.672190 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.672382 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.672510 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.672693 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.672834 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.673003 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.673139 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.673309 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.673525 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.673669 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.673880 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.674013 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.674145 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.674271 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.674403 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.674540 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.674665 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.674848 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.674978 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.675187 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.675337 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.675499 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.675630 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.675810 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.675947 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.676124 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.676266 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.676443 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.676571 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.676756 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.676884 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.677068 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.677209 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.677376 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.677512 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.677686 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.677814 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.677993 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.678123 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.678305 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.678434 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.678612 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.678739 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.678915 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.679053 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.679250 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.679377 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.679535 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.679664 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.679842 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.679973 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.680143 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.680281 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.680460 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.680589 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.680771 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.680902 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.681074 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.681201 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.681375 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.681503 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.681679 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.681810 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.681988 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.682126 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.682292 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.682433 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.682597 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.682724 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.682898 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.683028 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.683234 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.683378 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.683551 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.683695 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.683854 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.683950 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.684164 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.684278 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.684466 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.684559 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.684772 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.684870 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.685069 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.685164 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.685377 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.685463 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.685678 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.685773 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.685980 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.686072 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.686284 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.686370 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.686592 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.686739 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.687033 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.687423 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.687507 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.687586 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.687663 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.687771 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.687904 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.688092 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.688218 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.688410 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.688529 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.688745 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.688832 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.689074 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.689158 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.689380 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.689466 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.689705 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.689792 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.690030 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.690116 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.690341 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.690438 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.690642 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.690728 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.690949 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.691053 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.691280 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.691380 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.691587 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.691681 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.691895 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.691981 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.692204 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.692298 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.692505 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.692590 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.692808 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.692916 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.693110 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.693217 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.693406 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.693493 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.693705 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.693792 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.694015 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.694113 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.694319 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.694401 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.694620 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.694712 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.694922 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.695028 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.695246 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.695335 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.695552 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.695664 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.695875 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.695970 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.696181 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.696266 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.696485 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.696572 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.696789 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.696882 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.697090 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.697176 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.697427 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.697511 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.697731 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.697817 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.698039 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.698123 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.698352 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.698445 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.698665 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.698760 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.698975 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.699068 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.699323 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.699432 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.699635 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.699722 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.699945 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.700035 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.700253 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.700345 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.700564 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.700656 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.700872 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.700962 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.701190 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.701289 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.701497 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.701589 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.701816 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.701900 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.702128 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.702226 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.703045 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.703289 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.703450 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.703547 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.703681 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.703787 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.703989 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.704078 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.704308 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.704405 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.704648 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.704736 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.704962 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.705071 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.705274 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.705366 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.705590 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.705681 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.705900 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.705997 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.706206 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.706295 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.706515 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.706644 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.706819 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.706947 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.707148 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.707279 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.707465 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.707602 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.707782 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.707918 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.708081 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.708208 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.708393 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.708525 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.708702 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.708837 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.709023 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.709161 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.709328 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.709455 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.709638 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.709773 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.709940 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.710075 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.710248 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.710383 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.710555 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.710697 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.710862 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.711000 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.711192 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.711323 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.711500 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.711635 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.711808 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.711950 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.712116 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.712243 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.712424 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.712551 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.712731 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.712862 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.713034 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.713161 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.713341 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.713471 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.713644 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.713777 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.713952 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.714099 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.714251 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.714381 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.714557 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.714691 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.714869 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.714999 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.715190 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.715318 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.715504 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.715646 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.715807 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.715954 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.716094 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.716232 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.716393 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.716527 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.716711 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.716844 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.717018 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.717160 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.717319 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.717453 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.717620 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.717753 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.717993 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.719219 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.719219 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.719490 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.719625 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.719757 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.719888 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.720032 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.720166 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.720309 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.720440 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.720576 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.720725 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.720863 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.720994 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.721127 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.721264 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.721395 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.721534 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.721664 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.721801 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.721933 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.722063 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.722195 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.722333 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.722482 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.722620 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.722758 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.722890 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.723021 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.723176 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.723306 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.723518 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.723654 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.723785 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.723925 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.724057 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.724190 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.724274 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.724417 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.724506 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.724729 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.724817 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.725033 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.725119 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.725344 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.725432 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.725659 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.725753 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.725968 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.726226 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.726312 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.726559 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.726656 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.726866 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.726951 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.727207 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.727307 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.727526 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.727767 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.727854 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.728099 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.728197 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.728418 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.728585 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.728738 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.728824 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.729058 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.729153 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.729372 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.729463 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.729675 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.729762 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.729976 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.730069 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.730285 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.730371 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.730590 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.730693 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.730892 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.730985 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.731218 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.731307 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.731530 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.731626 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.731831 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.731916 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.732134 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.732219 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.732431 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.732523 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.732731 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.732816 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.733039 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.733123 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.733338 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.733431 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.733790 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.734184 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.734256 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.734333 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.734421 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.734545 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.734631 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.734716 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.734856 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.735011 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.735181 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.735358 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.735490 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.735663 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.735807 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.735985 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.736111 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.736296 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.736443 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.736601 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.736767 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.736905 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.737103 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.737210 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.737405 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.737550 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.737706 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.737854 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.738027 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.738190 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.738328 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.738515 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.738629 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.738853 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.738948 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.739179 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.739269 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.739487 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.739573 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.739810 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.739897 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.740113 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.740198 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.740417 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.740502 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.740720 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.740807 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.741023 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.741120 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.741326 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.741421 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.741626 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.741711 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.741924 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.742008 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.742233 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.742327 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.742537 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.742627 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.742836 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.742922 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.743159 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.743264 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.743468 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.743554 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.743772 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.743868 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.744068 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.744162 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.744373 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.744458 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.744673 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.744838 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.744982 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.745145 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.745283 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.745456 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.745588 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.745765 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.745860 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.746068 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.746162 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.746377 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.746464 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.746680 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.746775 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.746994 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.747110 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.747325 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.747412 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.747628 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.747726 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.747925 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.748010 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.748232 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.748316 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.748532 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.748626 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.748832 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.748924 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.749669 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.750449 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.750592 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.750716 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.750822 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.750822 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.750981 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.751060 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.751199 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.751291 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.751372 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.751449 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.751601 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.751739 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.751908 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.752045 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.752220 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.752344 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.752543 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.752708 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.752859 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.752945 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.753162 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.753255 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.753471 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.753565 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.753774 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.753922 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.754079 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.754173 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.754380 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.754474 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.754683 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.754769 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.754979 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.755063 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.755312 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.755415 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.755615 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.755702 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.755918 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.756040 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.756221 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.756333 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.756540 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.756626 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.756847 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.756934 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.757150 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.757240 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.757452 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.757537 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.757756 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.757841 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.758054 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.758146 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.758365 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.758450 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.758672 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.758769 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.758982 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.759069 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.759309 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.759396 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.759613 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.759723 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.759933 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.760028 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.760241 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.760326 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.760548 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.760647 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.760853 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.760982 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.761169 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.761267 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.761525 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.761642 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.761781 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.761884 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.762082 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.762168 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.762388 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.762488 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.762698 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.762784 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.763004 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.763111 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.763338 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.763441 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.763646 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.763741 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.763957 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.764044 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.764266 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.764353 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.764576 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.764662 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.765022 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.765479 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.765573 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.765661 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.765786 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.765878 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.766015 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.766102 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.766331 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.766419 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.766644 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.766736 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.766954 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.767039 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.767289 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.767386 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.767602 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.767694 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.767909 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.768007 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.768219 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.768334 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.768522 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.768628 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.768830 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.768938 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.769137 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.769235 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.769462 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.769560 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.769775 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.769892 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.770083 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.770180 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.770394 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.770501 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.770703 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.770817 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.771017 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.771156 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.771349 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.771452 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.771763 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.771861 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.772076 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.772173 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.772382 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.772478 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.772687 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.772784 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.772988 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.773091 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.773291 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.773388 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.773599 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.773697 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.773909 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.774025 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.774210 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.774305 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.774582 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.774687 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.774814 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.774917 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.775154 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.775262 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.775459 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.775547 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.775777 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.775907 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.776121 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.776215 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.776432 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.776519 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.776757 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.776845 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.777061 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.777160 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.777366 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.777452 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.777670 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.777756 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.777991 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.778085 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.778296 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.778383 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.778615 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.778702 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.778967 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.779053 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.779306 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.779394 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.779618 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.779702 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.779940 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.780036 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.780261 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.780347 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.781208 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.781603 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.781694 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.781775 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.781864 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.781982 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.782113 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.782305 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.782418 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.782627 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.782729 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.782942 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.783028 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.783355 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.783442 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.783674 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.783768 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.783986 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.784074 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.784304 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.784403 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.784605 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.784740 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.784927 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.785014 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.785248 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.785334 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.785560 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.785647 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.785867 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.785990 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.786170 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.786277 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.786474 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.786598 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.786794 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.786909 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.787112 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.787275 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.787430 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.787601 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.787743 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.787906 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.788051 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.788210 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.788352 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.788519 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.788656 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.788824 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.788974 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.789130 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.789276 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.789450 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.789598 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.789753 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.789910 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.790064 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.790228 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.790375 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.790546 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.790682 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.790849 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.790983 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.791192 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.791313 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.791500 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.791633 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.791802 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.791934 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.792105 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.792254 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.792408 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.792567 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.792746 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.792885 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.793050 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.793206 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.793375 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.793512 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.793703 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.793832 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.794029 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.794144 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.794344 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.794468 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.794676 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.794789 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.795000 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.795147 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.795353 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.795456 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.795671 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.795782 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.795994 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.796675 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.797290 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.797394 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.797476 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.797561 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.797641 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.797719 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.797797 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.797884 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.798119 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.798207 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.798427 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.798518 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.798735 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.798872 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.799038 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.799170 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.799370 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.799458 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.799670 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.799758 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.799983 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.800069 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.800284 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.800370 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.800587 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.800675 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.800891 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.800978 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.801192 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.801276 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.801492 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.801586 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.801791 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.801876 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.802090 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.802182 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.802411 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.802499 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.802716 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.802801 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.803037 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.803153 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.803373 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.803460 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.803679 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.803765 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.803985 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.804081 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.804287 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.804394 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.804609 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.804697 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.804917 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.805011 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.805230 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.805361 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.805545 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.805630 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.805860 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.805958 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.806173 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.806260 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.806479 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.806564 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.806785 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.806870 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.807119 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.807208 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.807429 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.807514 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.807745 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.807833 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.808056 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.808268 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.808362 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.808595 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.808690 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.808909 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.808996 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.809221 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.809314 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.809532 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.809629 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.809845 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.809931 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.810156 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.810248 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.810465 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.810681 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.810768 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.811013 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.811117 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.811358 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.811465 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.811732 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.812237 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.812343 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.812426 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.812505 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.812591 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.812672 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.812885 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.812972 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.813200 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.813298 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.813515 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.813601 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.813829 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.813917 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.814142 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.814237 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.814474 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.814602 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.814796 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.814884 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.815166 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.815259 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.815440 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.815538 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.815753 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.815839 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.816062 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.816150 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.816372 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.816458 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.816683 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.816770 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.816996 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.817083 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.817305 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.817391 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.817611 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.817706 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.817922 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.818008 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.818230 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.818316 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.818550 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.818645 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.818879 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.818965 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.819211 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.819301 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.819525 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.819612 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.819837 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.819930 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.820148 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.820233 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.820455 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.820667 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.820763 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.820982 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.821069 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.821310 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.821410 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.821653 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.821748 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.821957 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.822053 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.822270 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.822370 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.822585 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.822672 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.822896 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.822989 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.823230 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.823446 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.823533 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.823761 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.823857 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.824093 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.824188 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.824410 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.824495 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.824729 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.824815 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.825041 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.825171 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.825345 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.825465 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.825663 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.825753 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.825967 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.826064 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.826273 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.826497 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.826586 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.826846 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.826940 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.827188 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.827308 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.827567 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.827960 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.828042 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.828136 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.828218 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.828416 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.828503 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.828739 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.828826 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.829051 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.829140 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.829353 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.829588 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.829675 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.829934 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.830022 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.830250 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.830334 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.830555 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.830640 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.830865 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.830960 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.831197 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.831289 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.831502 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.831590 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.831812 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.831900 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.832112 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.832199 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.832416 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.832501 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.832726 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.832813 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.833035 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.833120 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.833336 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.833431 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.833641 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.833727 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.833943 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.834028 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.834247 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.834341 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.834548 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.834635 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.834850 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.834941 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.835176 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.835282 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.835481 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.835606 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.835789 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.835878 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.836091 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.836186 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.836392 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.836514 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.836692 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.836779 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.836998 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.837162 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.837303 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.837389 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.837608 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.837702 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.837913 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.838008 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.838224 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.838310 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.838530 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.838617 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.838836 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.838923 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.839159 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.839248 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.839472 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.839558 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.839779 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.839867 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.840089 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.840181 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.840423 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.840567 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.840748 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.840951 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.841047 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.841282 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.841377 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.841602 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.841698 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.841936 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.842032 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.842256 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.842349 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.842559 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.842646 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.842864 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.843520 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.844050 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.844136 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.844224 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.844305 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.844383 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.844640 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.844762 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.844953 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.845099 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.845263 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.845423 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.845573 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.845760 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.845884 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.846095 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.846181 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.846411 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.846497 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.846723 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.846821 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.847034 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.847158 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.847400 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.847485 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.847711 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.847810 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.848021 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.848108 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.848337 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.848422 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.848648 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.848735 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.848962 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.849060 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.849275 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.849363 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.849587 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.849673 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.849897 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.849990 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.850203 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.850295 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.850511 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.850599 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.850816 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.850901 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.851143 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.851246 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.851459 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.851552 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.851776 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.851863 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.852085 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.852183 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.852386 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.852474 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.852725 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.852810 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.853042 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.853142 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.853364 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.853450 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.853677 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.853763 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.853989 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.854089 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.854299 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.854398 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.854610 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.854697 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.854923 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.855047 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.855274 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.855371 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.855584 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.855676 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.855889 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.855976 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.856237 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.856324 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.856564 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.856659 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.856889 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.856976 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.857196 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.857283 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.857501 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.857597 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.857804 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.857891 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.858114 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.858199 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.858428 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.858626 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.859673 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.859745 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.859837 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.859925 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.859925 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.860085 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.860245 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.860334 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.860551 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.860640 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.860858 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.860946 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.861163 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.861248 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.861467 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.861552 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.861777 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.861865 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.862079 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.862164 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.862382 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.862476 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.862686 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.862773 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.862990 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.863074 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.863317 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.863419 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.863625 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.863713 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.863929 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.864014 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.864228 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.864326 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.864531 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.864615 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.864829 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.864914 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.865131 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.865228 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.865431 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.865517 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.865734 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.865821 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.866044 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.866139 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.866349 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.866435 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.866679 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.866763 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.866992 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.867112 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.867337 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.867424 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.867646 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.867743 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.867952 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.868084 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.868280 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.868369 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.868566 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.868652 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.868869 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.868964 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.869198 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.869283 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.869510 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.869596 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.869822 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.869910 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.870132 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.870218 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.870441 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.870534 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.870749 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.870840 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.871060 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.871214 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.871406 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.871506 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.871729 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.871815 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.872033 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.872121 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.872345 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.872439 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.872662 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.872754 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.872975 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.873060 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.873289 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.873386 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.873603 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.873691 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.873917 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.874002 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.874294 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.874900 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.874900 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.875055 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.875162 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.875232 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.875312 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.875393 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.875553 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.875689 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.875880 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.876007 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.876206 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.876324 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.876525 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.876648 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.876844 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.876988 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.877158 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.877270 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.877486 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.877594 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.877798 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.877920 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.878109 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.878265 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.878426 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.878577 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.878737 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.878918 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.879049 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.879270 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.879460 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.879585 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.879777 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.879897 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.880103 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.880189 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.880428 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 14:59:27.880514 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.880736 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.881060 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.881385 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.881733 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.882046 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.882392 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.882721 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.883035 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.883373 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.883681 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:27.883925 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 14:59:27.939033 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO dbcounter [None req-2b8206a4-287e-4722-80fc-bf3266d7699d None None] Registered counter for database nova_api May 26 14:59:27.942232 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO dbcounter [None req-1df17137-a6a9-4365-9ce8-6a0af98af9ee None None] Registered counter for database nova_api May 26 14:59:27.959055 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG oslo_db.sqlalchemy.engines [None req-2b8206a4-287e-4722-80fc-bf3266d7699d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103360) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 14:59:27.962018 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG oslo_db.sqlalchemy.engines [None req-1df17137-a6a9-4365-9ce8-6a0af98af9ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103361) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 14:59:27.965698 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writer thread running {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 14:59:27.969178 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writer thread running {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 14:59:28.023259 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.context [None req-2b8206a4-287e-4722-80fc-bf3266d7699d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),adff5b13-26db-46a1-a2eb-c66025319ac2(cell1) {{(pid=103360) load_cells /opt/stack/nova/nova/context.py:464}} May 26 14:59:28.028708 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.context [None req-1df17137-a6a9-4365-9ce8-6a0af98af9ee None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),adff5b13-26db-46a1-a2eb-c66025319ac2(cell1) {{(pid=103361) load_cells /opt/stack/nova/nova/context.py:464}} May 26 14:59:28.028832 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-2b8206a4-287e-4722-80fc-bf3266d7699d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:59:28.028928 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-2b8206a4-287e-4722-80fc-bf3266d7699d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:59:28.029720 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-2b8206a4-287e-4722-80fc-bf3266d7699d None None] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:59:28.031418 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG oslo_concurrency.lockutils [None req-1df17137-a6a9-4365-9ce8-6a0af98af9ee None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:59:28.032553 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-2b8206a4-287e-4722-80fc-bf3266d7699d None None] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:59:28.032988 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG oslo_concurrency.lockutils [None req-1df17137-a6a9-4365-9ce8-6a0af98af9ee None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:59:28.033792 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG oslo_concurrency.lockutils [None req-1df17137-a6a9-4365-9ce8-6a0af98af9ee None None] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:59:28.034549 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO dbcounter [None req-2b8206a4-287e-4722-80fc-bf3266d7699d None None] Registered counter for database nova_cell0 May 26 14:59:28.035786 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG oslo_concurrency.lockutils [None req-1df17137-a6a9-4365-9ce8-6a0af98af9ee None None] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:59:28.037788 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO dbcounter [None req-1df17137-a6a9-4365-9ce8-6a0af98af9ee None None] Registered counter for database nova_cell0 May 26 14:59:28.038593 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO dbcounter [None req-2b8206a4-287e-4722-80fc-bf3266d7699d None None] Registered counter for database nova_cell1 May 26 14:59:28.042240 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO dbcounter [None req-1df17137-a6a9-4365-9ce8-6a0af98af9ee None None] Registered counter for database nova_cell1 May 26 14:59:28.045268 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG oslo_db.sqlalchemy.engines [None req-2b8206a4-287e-4722-80fc-bf3266d7699d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103360) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 14:59:28.051066 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writer thread running {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 14:59:28.051693 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG oslo_db.sqlalchemy.engines [None req-1df17137-a6a9-4365-9ce8-6a0af98af9ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103361) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 14:59:28.056215 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writer thread running {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 14:59:28.057638 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG oslo_db.sqlalchemy.engines [None req-1df17137-a6a9-4365-9ce8-6a0af98af9ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103361) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 14:59:28.189138 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG oslo_db.sqlalchemy.engines [None req-2b8206a4-287e-4722-80fc-bf3266d7699d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103360) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 14:59:28.198599 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writer thread running {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 14:59:28.201175 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writer thread running {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 14:59:28.208442 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO dbcounter [None req-2b8206a4-287e-4722-80fc-bf3266d7699d None None] Registered counter for database nova_cell0 May 26 14:59:28.210655 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO dbcounter [None req-1df17137-a6a9-4365-9ce8-6a0af98af9ee None None] Registered counter for database nova_cell0 May 26 14:59:28.217305 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG oslo_db.sqlalchemy.engines [None req-2b8206a4-287e-4722-80fc-bf3266d7699d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103360) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 14:59:28.221524 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG oslo_db.sqlalchemy.engines [None req-1df17137-a6a9-4365-9ce8-6a0af98af9ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103361) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 14:59:28.222435 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writer thread running {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 14:59:28.226153 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writer thread running {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 14:59:28.570184 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: WARNING keystonemiddleware.auth_token [None req-2b8206a4-287e-4722-80fc-bf3266d7699d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 14:59:28.577667 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: WARNING keystonemiddleware.auth_token [None req-2b8206a4-287e-4722-80fc-bf3266d7699d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 14:59:28.628576 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: WARNING keystonemiddleware.auth_token [None req-1df17137-a6a9-4365-9ce8-6a0af98af9ee None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 14:59:28.638738 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: WARNING keystonemiddleware.auth_token [None req-1df17137-a6a9-4365-9ce8-6a0af98af9ee None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 14:59:28.928053 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: WARNING keystonemiddleware.auth_token [None req-2b8206a4-287e-4722-80fc-bf3266d7699d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 14:59:28.934232 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: WARNING keystonemiddleware.auth_token [None req-2b8206a4-287e-4722-80fc-bf3266d7699d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 14:59:28.940195 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5605d9a9a9c0 pid: 103360 (default app) May 26 14:59:28.942306 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-2b8206a4-287e-4722-80fc-bf3266d7699d None None] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:28.943536 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-2b8206a4-287e-4722-80fc-bf3266d7699d None None] 10.222.0.45 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001807 May 26 14:59:28.944229 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 788 bytes} [Thu May 26 14:59:28 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:59:29.065444 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: WARNING keystonemiddleware.auth_token [None req-1df17137-a6a9-4365-9ce8-6a0af98af9ee None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 14:59:29.072756 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: WARNING keystonemiddleware.auth_token [None req-1df17137-a6a9-4365-9ce8-6a0af98af9ee None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 14:59:29.080601 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5605d9a9a9c0 pid: 103361 (default app) May 26 15:00:47.251749 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-2b8206a4-287e-4722-80fc-bf3266d7699d None None] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:47.252752 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-2b8206a4-287e-4722-80fc-bf3266d7699d None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 May 26 15:00:47.253154 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 2/2] 10.222.0.45 () {54 vars in 930 bytes} [Thu May 26 15:00:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:00:47.265028 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writing DB stats nova_api:SELECT=3 {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:00:47.266127 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writing DB stats nova_cell1:SELECT=3 {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:00:47.267122 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writing DB stats nova_cell0:SELECT=3 {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:00:47.268106 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:00:47.723564 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-856425dc-3f0e-4f6a-9ea6-216303bb766b admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:47.753661 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-856425dc-3f0e-4f6a-9ea6-216303bb766b admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.493906 May 26 15:00:47.754419 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 1/3] 10.222.0.45 () {60 vars in 1291 bytes} [Thu May 26 15:00:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:50.048205 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-2b8206a4-287e-4722-80fc-bf3266d7699d None None] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:50.049223 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-2b8206a4-287e-4722-80fc-bf3266d7699d None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 May 26 15:00:50.049616 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 3/4] 10.222.0.45 () {54 vars in 930 bytes} [Thu May 26 15:00:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:00:50.121036 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-a21a2760-c13d-41c0-acbb-96192e3c9c04 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "os-flavor-access:is_public": true, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "disk": 1}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:00:50.142583 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:00:50.142583 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: warnings.warn(msg) May 26 15:00:50.174191 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-a21a2760-c13d-41c0-acbb-96192e3c9c04 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.118555 May 26 15:00:50.179220 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 2/5] 10.222.0.45 () {64 vars in 1282 bytes} [Thu May 26 15:00:50 2022] POST /compute/v2.1/flavors => generated 407 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 15:00:50.403273 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-c48355b0-4831-4c25-b081-e95b5603dc2b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:00:50.406935 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:00:50.406935 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: warnings.warn(msg) May 26 15:00:50.409672 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_api:SELECT=3 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:00:50.410486 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_cell0:SELECT=3 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:00:50.411376 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_cell1:SELECT=3 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:00:50.412068 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:00:50.476406 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-c48355b0-4831-4c25-b081-e95b5603dc2b admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.293205 May 26 15:00:50.479283 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 4/6] 10.222.0.45 () {64 vars in 1335 bytes} [Thu May 26 15:00:50 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:52.747611 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-a21a2760-c13d-41c0-acbb-96192e3c9c04 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:52.748642 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-a21a2760-c13d-41c0-acbb-96192e3c9c04 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 May 26 15:00:52.749043 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 3/7] 10.222.0.45 () {54 vars in 930 bytes} [Thu May 26 15:00:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:00:52.886377 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-96274f36-9c46-4914-9ac0-c0ec088f195d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 5, "swap": 0, "vcpus": 1, "id": "d1", "rxtx_factor": 1.0, "name": "ds512M"}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:00:52.905447 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:00:52.905447 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: warnings.warn(msg) May 26 15:00:52.923805 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-96274f36-9c46-4914-9ac0-c0ec088f195d admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.168797 May 26 15:00:52.931324 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 5/8] 10.222.0.45 () {64 vars in 1282 bytes} [Thu May 26 15:00:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 15:00:52.936654 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-c6c25577-865a-41f6-a4a0-d252febbf54b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:00:52.938163 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:00:52.938163 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: warnings.warn(msg) May 26 15:00:52.970049 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-c6c25577-865a-41f6-a4a0-d252febbf54b admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037494 May 26 15:00:52.970613 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 4/9] 10.222.0.45 () {64 vars in 1335 bytes} [Thu May 26 15:00:52 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:00:55.232904 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-96274f36-9c46-4914-9ac0-c0ec088f195d admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:55.234624 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-96274f36-9c46-4914-9ac0-c0ec088f195d admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002169 May 26 15:00:55.235256 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 6/10] 10.222.0.45 () {54 vars in 930 bytes} [Thu May 26 15:00:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:00:55.298970 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-a678ba37-4c70-42a6-9f8b-a1ee5615230b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "ram": 1024, "rxtx_factor": 1.0, "disk": 10, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "name": "ds1G"}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:00:55.319464 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-a678ba37-4c70-42a6-9f8b-a1ee5615230b admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077890 May 26 15:00:55.320295 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 5/11] 10.222.0.45 () {64 vars in 1282 bytes} [Thu May 26 15:00:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:00:55.332327 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-58c5fdaf-7bc7-4b02-8ab2-aa04ca51ed71 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:00:55.356181 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-58c5fdaf-7bc7-4b02-8ab2-aa04ca51ed71 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027462 May 26 15:00:55.356907 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 7/12] 10.222.0.45 () {64 vars in 1335 bytes} [Thu May 26 15:00:55 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:57.664374 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-a678ba37-4c70-42a6-9f8b-a1ee5615230b admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:57.665393 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-a678ba37-4c70-42a6-9f8b-a1ee5615230b admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 May 26 15:00:57.665795 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 6/13] 10.222.0.45 () {54 vars in 930 bytes} [Thu May 26 15:00:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:00:57.728683 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-a56b8b8a-8f46-444f-a4f4-a6d75a4a1925 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "swap": 0, "disk": 10, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 2, "name": "ds2G"}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:00:57.748103 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-a56b8b8a-8f46-444f-a4f4-a6d75a4a1925 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075259 May 26 15:00:57.748837 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 8/14] 10.222.0.45 () {64 vars in 1282 bytes} [Thu May 26 15:00:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:00:57.760680 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-2808576d-0eaa-4884-8568-57f6c26c88aa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:00:57.785898 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-2808576d-0eaa-4884-8568-57f6c26c88aa admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028811 May 26 15:00:57.787163 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 7/15] 10.222.0.45 () {64 vars in 1335 bytes} [Thu May 26 15:00:57 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:00.068986 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-a56b8b8a-8f46-444f-a4f4-a6d75a4a1925 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:00.069979 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-a56b8b8a-8f46-444f-a4f4-a6d75a4a1925 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 May 26 15:01:00.070374 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 9/16] 10.222.0.45 () {54 vars in 930 bytes} [Thu May 26 15:01:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:00.130242 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-ad1341f0-afd2-461a-8e21-f17db79a3592 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds4G", "os-flavor-access:is_public": true, "id": "d4", "disk": 20, "ram": 4096, "rxtx_factor": 1.0, "vcpus": 4}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:00.148553 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-ad1341f0-afd2-461a-8e21-f17db79a3592 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071329 May 26 15:01:00.149139 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 8/17] 10.222.0.45 () {64 vars in 1282 bytes} [Thu May 26 15:01:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:01:00.162348 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-8fc46469-ef51-49e5-b0a0-72709b999899 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:00.186774 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-8fc46469-ef51-49e5-b0a0-72709b999899 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028468 May 26 15:01:00.187641 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 10/18] 10.222.0.45 () {64 vars in 1335 bytes} [Thu May 26 15:01:00 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:02.476762 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-ad1341f0-afd2-461a-8e21-f17db79a3592 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:02.477775 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-ad1341f0-afd2-461a-8e21-f17db79a3592 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 May 26 15:01:02.478181 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 9/19] 10.222.0.45 () {54 vars in 930 bytes} [Thu May 26 15:01:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:02.540006 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-c1d04951-bbec-4e78-a572-1b8500b75b60 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:02.564377 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-c1d04951-bbec-4e78-a572-1b8500b75b60 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079457 May 26 15:01:02.565124 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 11/20] 10.222.0.45 () {60 vars in 1291 bytes} [Thu May 26 15:01:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:01:04.921499 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-ad1341f0-afd2-461a-8e21-f17db79a3592 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:04.922504 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-ad1341f0-afd2-461a-8e21-f17db79a3592 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 May 26 15:01:04.922902 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 10/21] 10.222.0.45 () {54 vars in 930 bytes} [Thu May 26 15:01:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:01:05.006427 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-c19ae474-6813-485b-9bbe-71e9ae6f03f7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "rxtx_factor": 1.0, "ram": 512, "swap": 0, "name": "m1.tiny", "os-flavor-access:is_public": true, "id": "1"}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:05.024570 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-c19ae474-6813-485b-9bbe-71e9ae6f03f7 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.095819 May 26 15:01:05.025114 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 12/22] 10.222.0.45 () {64 vars in 1282 bytes} [Thu May 26 15:01:04 2022] POST /compute/v2.1/flavors => generated 402 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:01:05.040959 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-a7eaed46-a0f0-41b1-90fa-8e3f3fbb309f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:05.075987 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-a7eaed46-a0f0-41b1-90fa-8e3f3fbb309f admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041432 May 26 15:01:05.077262 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 11/23] 10.222.0.45 () {64 vars in 1332 bytes} [Thu May 26 15:01:05 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:07.535504 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-c19ae474-6813-485b-9bbe-71e9ae6f03f7 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:07.536540 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-c19ae474-6813-485b-9bbe-71e9ae6f03f7 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001682 May 26 15:01:07.536944 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 13/24] 10.222.0.45 () {54 vars in 930 bytes} [Thu May 26 15:01:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:07.618079 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-504839f0-7945-45d0-9a6d-ac67f5428aaa admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "ram": 2048, "vcpus": 1, "rxtx_factor": 1.0, "id": "2", "name": "m1.small"}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:07.636934 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-504839f0-7945-45d0-9a6d-ac67f5428aaa admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.093904 May 26 15:01:07.638780 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 12/25] 10.222.0.45 () {64 vars in 1282 bytes} [Thu May 26 15:01:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:01:07.650762 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-2eb366e6-7798-4ae7-96d9-1c78f247e22d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:07.676864 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-2eb366e6-7798-4ae7-96d9-1c78f247e22d admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029941 May 26 15:01:07.677475 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 14/26] 10.222.0.45 () {64 vars in 1332 bytes} [Thu May 26 15:01:07 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:09.954248 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-504839f0-7945-45d0-9a6d-ac67f5428aaa admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:09.955316 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-504839f0-7945-45d0-9a6d-ac67f5428aaa admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 May 26 15:01:09.955742 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 13/27] 10.222.0.45 () {54 vars in 930 bytes} [Thu May 26 15:01:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:10.015575 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-40e69c09-c94c-4ff2-bafe-fc03afbcd43b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "name": "m1.medium", "vcpus": 2, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "swap": 0, "os-flavor-access:is_public": true, "disk": 40}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:10.033793 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-40e69c09-c94c-4ff2-bafe-fc03afbcd43b admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.072074 May 26 15:01:10.038337 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 15/28] 10.222.0.45 () {64 vars in 1282 bytes} [Thu May 26 15:01:09 2022] POST /compute/v2.1/flavors => generated 406 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 15:01:10.046630 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-03b85537-1d14-4fb0-8d95-509e286f7d64 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:10.069553 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-03b85537-1d14-4fb0-8d95-509e286f7d64 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026986 May 26 15:01:10.070121 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 14/29] 10.222.0.45 () {64 vars in 1332 bytes} [Thu May 26 15:01:10 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:12.366829 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-40e69c09-c94c-4ff2-bafe-fc03afbcd43b admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:12.367889 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-40e69c09-c94c-4ff2-bafe-fc03afbcd43b admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 May 26 15:01:12.368302 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 16/30] 10.222.0.45 () {54 vars in 930 bytes} [Thu May 26 15:01:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:12.427313 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-02c16355-2f56-4ba1-9cef-cb4352d49e0b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "disk": 80, "name": "m1.large", "rxtx_factor": 1.0, "vcpus": 4, "ram": 8192, "os-flavor-access:is_public": true}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:12.445924 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-02c16355-2f56-4ba1-9cef-cb4352d49e0b admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071561 May 26 15:01:12.446702 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 15/31] 10.222.0.45 () {64 vars in 1282 bytes} [Thu May 26 15:01:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:01:12.459356 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-f7587a3e-2923-4c1b-9c27-94b5f0fff0d3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:12.483052 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-f7587a3e-2923-4c1b-9c27-94b5f0fff0d3 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027535 May 26 15:01:12.483713 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 17/32] 10.222.0.45 () {64 vars in 1332 bytes} [Thu May 26 15:01:12 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:01:14.808364 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-02c16355-2f56-4ba1-9cef-cb4352d49e0b admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:14.809857 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-02c16355-2f56-4ba1-9cef-cb4352d49e0b admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 May 26 15:01:14.810843 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 16/33] 10.222.0.45 () {54 vars in 930 bytes} [Thu May 26 15:01:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:14.876762 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-9e7f65d2-7015-4227-8bfd-6d9b36e996d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "swap": 0, "ram": 16384, "name": "m1.xlarge", "rxtx_factor": 1.0, "vcpus": 8}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:14.896334 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-9e7f65d2-7015-4227-8bfd-6d9b36e996d7 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.080004 May 26 15:01:14.897021 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 18/34] 10.222.0.45 () {64 vars in 1282 bytes} [Thu May 26 15:01:14 2022] POST /compute/v2.1/flavors => generated 408 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 15:01:14.909656 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-275ce617-902d-450c-8f01-5195a9498ced admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:14.933472 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-275ce617-902d-450c-8f01-5195a9498ced admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027483 May 26 15:01:14.934388 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 17/35] 10.222.0.45 () {64 vars in 1332 bytes} [Thu May 26 15:01:14 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:39.297425 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-9e7f65d2-7015-4227-8bfd-6d9b36e996d7 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:39.298357 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-9e7f65d2-7015-4227-8bfd-6d9b36e996d7 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 May 26 15:01:39.298742 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 19/36] 10.222.0.45 () {54 vars in 930 bytes} [Thu May 26 15:01:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:39.309711 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:01:39.359217 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-d8733e38-e246-46af-b14d-1eceb456508a admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:39.376128 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-d8733e38-e246-46af-b14d-1eceb456508a admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071416 May 26 15:01:39.376665 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 18/37] 10.222.0.45 () {60 vars in 1291 bytes} [Thu May 26 15:01:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:01:40.388771 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-9e7f65d2-7015-4227-8bfd-6d9b36e996d7 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:40.389768 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-9e7f65d2-7015-4227-8bfd-6d9b36e996d7 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 May 26 15:01:40.390181 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 20/38] 10.222.0.45 () {56 vars in 1074 bytes} [Thu May 26 15:01:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:40.606443 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-b89a3f4e-8f0e-4690-95ca-cafa9aaad28f admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:40.612060 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.wsgi [None req-b89a3f4e-8f0e-4690-95ca-cafa9aaad28f admin admin] HTTP exception thrown: Flavor 42 could not be found. May 26 15:01:40.615269 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-b89a3f4e-8f0e-4690-95ca-cafa9aaad28f admin admin] Request method failure captured: May 26 15:01:40.615269 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 26 15:01:40.615269 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: Accept: application/json May 26 15:01:40.615269 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: Accept-Encoding: gzip, deflate May 26 15:01:40.615269 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: Connection: keep-alive May 26 15:01:40.615269 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: Content-Length: 0 May 26 15:01:40.615269 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: Host: 10.222.0.45 May 26 15:01:40.615269 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: Openstack-Api-Version: compute 2.90 May 26 15:01:40.615269 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: Openstack-System-Scope: None May 26 15:01:40.615269 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: User-Agent: python-novaclient May 26 15:01:40.615269 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Auth-Token: gAAAAABij5ZUHac77-CsC992KsCYDKaCglVhDVTMAj8wV6IT_eVFi1IR7o-wmr7Iylm9GyX_tNsycyX3QaQvusN940RjE8gqjsyiodC6_XXuQs_eP0uULBb67ClZ2Br6mSPDK8-L4KYyn_JYRtkau1dHHxetynlWlZU2qCw92E-WVZrLrQT7c1E May 26 15:01:40.615269 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Domain-Id: None May 26 15:01:40.615269 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Domain-Name: None May 26 15:01:40.615269 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Identity-Status: Confirmed May 26 15:01:40.615269 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Is-Admin-Project: True May 26 15:01:40.615269 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Openstack-Nova-Api-Version: 2.90 May 26 15:01:40.615269 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Project-Domain-Id: default May 26 15:01:40.615269 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Project-Domain-Name: Default May 26 15:01:40.615269 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Project-Id: e013887c316445b783792ef3f307427d May 26 15:01:40.615269 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Project-Name: admin May 26 15:01:40.615269 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Role: reader,admin,member May 26 15:01:40.615269 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Roles: reader,admin,member May 26 15:01:40.616972 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e013887c316445b783792ef3f307427d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e013887c316445b783792ef3f307427d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e013887c316445b783792ef3f307427d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e013887c316445b783792ef3f307427d"}]}] May 26 15:01:40.616972 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Tenant: admin May 26 15:01:40.616972 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Tenant-Id: e013887c316445b783792ef3f307427d May 26 15:01:40.616972 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Tenant-Name: admin May 26 15:01:40.616972 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-User: admin May 26 15:01:40.616972 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-User-Domain-Id: default May 26 15:01:40.616972 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-User-Domain-Name: Default May 26 15:01:40.616972 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-User-Id: 6cc1f206a7534d478df8987147a33502 May 26 15:01:40.616972 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-User-Name: admin May 26 15:01:40.616972 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: method: > May 26 15:01:40.616972 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: exception: Flavor 42 could not be found. May 26 15:01:40.616972 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: action_args: {'id': '42'} May 26 15:01:40.616972 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:01:40.616972 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:01:40.618186 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 15:01:40.618186 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 15:01:40.618186 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 15:01:40.618186 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 15:01:40.618186 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 15:01:40.618186 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 15:01:40.618186 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 15:01:40.618186 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 15:01:40.618186 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 15:01:40.618186 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:01:40.618186 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 15:01:40.618186 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 15:01:40.618186 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 26 15:01:40.618186 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi May 26 15:01:40.618186 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:01:40.618186 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi May 26 15:01:40.618186 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:01:40.618186 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:01:40.618186 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:01:40.619691 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:01:40.619691 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:01:40.619691 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:01:40.619691 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:01:40.619691 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 15:01:40.619691 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 15:01:40.619691 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 26 15:01:40.619691 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi May 26 15:01:40.619691 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:01:40.619691 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi May 26 15:01:40.619691 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:01:40.619691 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:01:40.619691 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:01:40.619691 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:01:40.619691 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:01:40.619691 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 26 15:01:40.619691 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi May 26 15:01:40.619691 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-b89a3f4e-8f0e-4690-95ca-cafa9aaad28f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:01:40.621026 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-b89a3f4e-8f0e-4690-95ca-cafa9aaad28f admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061936 May 26 15:01:40.621026 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 19/39] 10.222.0.45 () {60 vars in 1190 bytes} [Thu May 26 15:01:40 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 15:01:40.626372 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-043960e1-c5ab-4ed4-b27e-42975f003688 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:40.629291 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:01:40.648488 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-043960e1-c5ab-4ed4-b27e-42975f003688 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025654 May 26 15:01:40.649020 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 21/40] 10.222.0.45 () {60 vars in 1210 bytes} [Thu May 26 15:01:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:01:40.659343 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-37bb4675-056f-4a52-9771-8a676c3c9948 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:40.680933 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-37bb4675-056f-4a52-9771-8a676c3c9948 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025146 May 26 15:01:40.681474 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 20/41] 10.222.0.45 () {60 vars in 1210 bytes} [Thu May 26 15:01:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:01:40.691166 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-8d8a3280-fc8f-4b33-94c5-a0aa544d14c7 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:40.697404 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.wsgi [None req-8d8a3280-fc8f-4b33-94c5-a0aa544d14c7 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 26 15:01:40.701272 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-8d8a3280-fc8f-4b33-94c5-a0aa544d14c7 admin admin] Request method failure captured: May 26 15:01:40.701272 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 26 15:01:40.701272 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: Accept: application/json May 26 15:01:40.701272 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: Accept-Encoding: gzip, deflate May 26 15:01:40.701272 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: Connection: keep-alive May 26 15:01:40.701272 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: Content-Length: 0 May 26 15:01:40.701272 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: Host: 10.222.0.45 May 26 15:01:40.701272 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: Openstack-Api-Version: compute 2.90 May 26 15:01:40.701272 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: Openstack-System-Scope: None May 26 15:01:40.701272 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: User-Agent: python-novaclient May 26 15:01:40.701272 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Auth-Token: gAAAAABij5ZUHac77-CsC992KsCYDKaCglVhDVTMAj8wV6IT_eVFi1IR7o-wmr7Iylm9GyX_tNsycyX3QaQvusN940RjE8gqjsyiodC6_XXuQs_eP0uULBb67ClZ2Br6mSPDK8-L4KYyn_JYRtkau1dHHxetynlWlZU2qCw92E-WVZrLrQT7c1E May 26 15:01:40.701272 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Domain-Id: None May 26 15:01:40.701272 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Domain-Name: None May 26 15:01:40.701272 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Identity-Status: Confirmed May 26 15:01:40.701272 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Is-Admin-Project: True May 26 15:01:40.701272 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Openstack-Nova-Api-Version: 2.90 May 26 15:01:40.701272 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Project-Domain-Id: default May 26 15:01:40.701272 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Project-Domain-Name: Default May 26 15:01:40.701272 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Project-Id: e013887c316445b783792ef3f307427d May 26 15:01:40.701272 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Project-Name: admin May 26 15:01:40.701272 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Role: reader,admin,member May 26 15:01:40.701272 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Roles: reader,admin,member May 26 15:01:40.702740 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e013887c316445b783792ef3f307427d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e013887c316445b783792ef3f307427d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e013887c316445b783792ef3f307427d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e013887c316445b783792ef3f307427d"}]}] May 26 15:01:40.702740 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Tenant: admin May 26 15:01:40.702740 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Tenant-Id: e013887c316445b783792ef3f307427d May 26 15:01:40.702740 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Tenant-Name: admin May 26 15:01:40.702740 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-User: admin May 26 15:01:40.702740 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-User-Domain-Id: default May 26 15:01:40.702740 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-User-Domain-Name: Default May 26 15:01:40.702740 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-User-Id: 6cc1f206a7534d478df8987147a33502 May 26 15:01:40.702740 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-User-Name: admin May 26 15:01:40.702740 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: method: > May 26 15:01:40.702740 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: exception: Flavor 42 could not be found. May 26 15:01:40.702740 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: action_args: {'id': '42'} May 26 15:01:40.702740 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:01:40.702740 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:01:40.703751 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 15:01:40.703751 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 15:01:40.703751 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 15:01:40.703751 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 15:01:40.703751 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 15:01:40.703751 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 15:01:40.703751 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 15:01:40.703751 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 15:01:40.703751 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 15:01:40.703751 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:01:40.703751 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 15:01:40.703751 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 15:01:40.703751 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 26 15:01:40.703751 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi May 26 15:01:40.703751 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:01:40.703751 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi May 26 15:01:40.703751 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:01:40.703751 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:01:40.703751 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:01:40.705024 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:01:40.705024 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:01:40.705024 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:01:40.705024 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:01:40.705024 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 15:01:40.705024 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 15:01:40.705024 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 26 15:01:40.705024 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi May 26 15:01:40.705024 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:01:40.705024 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi May 26 15:01:40.705024 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:01:40.705024 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:01:40.705024 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:01:40.705024 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:01:40.705024 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:01:40.705024 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 26 15:01:40.705024 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi May 26 15:01:40.705024 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-8d8a3280-fc8f-4b33-94c5-a0aa544d14c7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:01:40.706263 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-8d8a3280-fc8f-4b33-94c5-a0aa544d14c7 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015043 May 26 15:01:40.706263 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 22/42] 10.222.0.45 () {60 vars in 1190 bytes} [Thu May 26 15:01:40 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 15:01:41.568482 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-37bb4675-056f-4a52-9771-8a676c3c9948 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:41.569808 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-37bb4675-056f-4a52-9771-8a676c3c9948 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001765 May 26 15:01:41.570200 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 21/43] 10.222.0.45 () {56 vars in 1074 bytes} [Thu May 26 15:01:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:41.758315 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-75144c58-0681-433a-8ac6-68f424e8268b admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:41.764360 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.wsgi [None req-75144c58-0681-433a-8ac6-68f424e8268b admin admin] HTTP exception thrown: Flavor 84 could not be found. May 26 15:01:41.765852 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-75144c58-0681-433a-8ac6-68f424e8268b admin admin] Request method failure captured: May 26 15:01:41.765852 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 26 15:01:41.765852 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: Accept: application/json May 26 15:01:41.765852 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: Accept-Encoding: gzip, deflate May 26 15:01:41.765852 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: Connection: keep-alive May 26 15:01:41.765852 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: Content-Length: 0 May 26 15:01:41.765852 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: Host: 10.222.0.45 May 26 15:01:41.765852 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: Openstack-Api-Version: compute 2.90 May 26 15:01:41.765852 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: Openstack-System-Scope: None May 26 15:01:41.765852 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: User-Agent: python-novaclient May 26 15:01:41.765852 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Auth-Token: gAAAAABij5ZVmXQx29IyczjPdOBMynSsoPEH3EQVTzvVrUdXwZh9c6GVGEAPGehfZRo25N0wh4BawoCIfuvSbGqxVvRRUAt_r5_YryQNgYJ4eZZkwkKLHJtDfKjLuHfHRtDt-B9EYYAxih7pb74IUha2rydTFj1DyRdiz4BNu1P8zso9XIyJoL0 May 26 15:01:41.765852 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Domain-Id: None May 26 15:01:41.765852 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Domain-Name: None May 26 15:01:41.765852 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Identity-Status: Confirmed May 26 15:01:41.765852 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Is-Admin-Project: True May 26 15:01:41.765852 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Openstack-Nova-Api-Version: 2.90 May 26 15:01:41.765852 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Project-Domain-Id: default May 26 15:01:41.765852 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Project-Domain-Name: Default May 26 15:01:41.765852 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Project-Id: e013887c316445b783792ef3f307427d May 26 15:01:41.765852 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Project-Name: admin May 26 15:01:41.765852 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Role: reader,admin,member May 26 15:01:41.765852 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Roles: reader,admin,member May 26 15:01:41.767402 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e013887c316445b783792ef3f307427d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e013887c316445b783792ef3f307427d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e013887c316445b783792ef3f307427d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e013887c316445b783792ef3f307427d"}]}] May 26 15:01:41.767402 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Tenant: admin May 26 15:01:41.767402 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Tenant-Id: e013887c316445b783792ef3f307427d May 26 15:01:41.767402 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Tenant-Name: admin May 26 15:01:41.767402 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-User: admin May 26 15:01:41.767402 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-User-Domain-Id: default May 26 15:01:41.767402 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-User-Domain-Name: Default May 26 15:01:41.767402 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-User-Id: 6cc1f206a7534d478df8987147a33502 May 26 15:01:41.767402 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-User-Name: admin May 26 15:01:41.767402 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: method: > May 26 15:01:41.767402 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: exception: Flavor 84 could not be found. May 26 15:01:41.767402 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: action_args: {'id': '84'} May 26 15:01:41.767402 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:01:41.767402 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:01:41.768412 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 15:01:41.768412 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 15:01:41.768412 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 15:01:41.768412 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 15:01:41.768412 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 15:01:41.768412 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 15:01:41.768412 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 15:01:41.768412 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 15:01:41.768412 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 15:01:41.768412 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:01:41.768412 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 15:01:41.768412 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 15:01:41.768412 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 26 15:01:41.768412 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi May 26 15:01:41.768412 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:01:41.768412 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi May 26 15:01:41.768412 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:01:41.768412 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:01:41.768412 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:01:41.769730 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:01:41.769730 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:01:41.769730 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:01:41.769730 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:01:41.769730 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 15:01:41.769730 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 15:01:41.769730 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 26 15:01:41.769730 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi May 26 15:01:41.769730 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:01:41.769730 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi May 26 15:01:41.769730 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:01:41.769730 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:01:41.769730 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:01:41.769730 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:01:41.769730 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:01:41.769730 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 26 15:01:41.769730 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi May 26 15:01:41.769730 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-75144c58-0681-433a-8ac6-68f424e8268b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:01:41.771161 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-75144c58-0681-433a-8ac6-68f424e8268b admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060781 May 26 15:01:41.771161 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 23/44] 10.222.0.45 () {60 vars in 1190 bytes} [Thu May 26 15:01:41 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 15:01:41.777034 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-ce39569f-4624-430f-a281-832d2a6d6dd2 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:41.792527 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-ce39569f-4624-430f-a281-832d2a6d6dd2 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019084 May 26 15:01:41.793590 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 22/45] 10.222.0.45 () {60 vars in 1210 bytes} [Thu May 26 15:01:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:01:41.803462 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-673d2196-2ee1-4e2b-b840-ee0006863299 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:41.817813 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-673d2196-2ee1-4e2b-b840-ee0006863299 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017851 May 26 15:01:41.818344 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 24/46] 10.222.0.45 () {60 vars in 1210 bytes} [Thu May 26 15:01:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:01:41.827850 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-376a57a3-7854-4623-a07a-cc1a5df24aa5 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:41.833174 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.wsgi [None req-376a57a3-7854-4623-a07a-cc1a5df24aa5 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 26 15:01:41.834653 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-376a57a3-7854-4623-a07a-cc1a5df24aa5 admin admin] Request method failure captured: May 26 15:01:41.834653 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 26 15:01:41.834653 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: Accept: application/json May 26 15:01:41.834653 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: Accept-Encoding: gzip, deflate May 26 15:01:41.834653 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: Connection: keep-alive May 26 15:01:41.834653 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: Content-Length: 0 May 26 15:01:41.834653 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: Host: 10.222.0.45 May 26 15:01:41.834653 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: Openstack-Api-Version: compute 2.90 May 26 15:01:41.834653 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: Openstack-System-Scope: None May 26 15:01:41.834653 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: User-Agent: python-novaclient May 26 15:01:41.834653 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Auth-Token: gAAAAABij5ZVmXQx29IyczjPdOBMynSsoPEH3EQVTzvVrUdXwZh9c6GVGEAPGehfZRo25N0wh4BawoCIfuvSbGqxVvRRUAt_r5_YryQNgYJ4eZZkwkKLHJtDfKjLuHfHRtDt-B9EYYAxih7pb74IUha2rydTFj1DyRdiz4BNu1P8zso9XIyJoL0 May 26 15:01:41.834653 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Domain-Id: None May 26 15:01:41.834653 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Domain-Name: None May 26 15:01:41.834653 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Identity-Status: Confirmed May 26 15:01:41.834653 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Is-Admin-Project: True May 26 15:01:41.834653 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Openstack-Nova-Api-Version: 2.90 May 26 15:01:41.834653 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Project-Domain-Id: default May 26 15:01:41.834653 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Project-Domain-Name: Default May 26 15:01:41.834653 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Project-Id: e013887c316445b783792ef3f307427d May 26 15:01:41.834653 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Project-Name: admin May 26 15:01:41.834653 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Role: reader,admin,member May 26 15:01:41.834653 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Roles: reader,admin,member May 26 15:01:41.836087 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e013887c316445b783792ef3f307427d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e013887c316445b783792ef3f307427d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e013887c316445b783792ef3f307427d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e013887c316445b783792ef3f307427d"}]}] May 26 15:01:41.836087 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Tenant: admin May 26 15:01:41.836087 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Tenant-Id: e013887c316445b783792ef3f307427d May 26 15:01:41.836087 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Tenant-Name: admin May 26 15:01:41.836087 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-User: admin May 26 15:01:41.836087 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-User-Domain-Id: default May 26 15:01:41.836087 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-User-Domain-Name: Default May 26 15:01:41.836087 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-User-Id: 6cc1f206a7534d478df8987147a33502 May 26 15:01:41.836087 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-User-Name: admin May 26 15:01:41.836087 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: method: > May 26 15:01:41.836087 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: exception: Flavor 84 could not be found. May 26 15:01:41.836087 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: action_args: {'id': '84'} May 26 15:01:41.836087 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:01:41.836087 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:01:41.836919 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 15:01:41.836919 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 15:01:41.836919 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 15:01:41.836919 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 15:01:41.836919 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 15:01:41.836919 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 15:01:41.836919 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 15:01:41.836919 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 15:01:41.836919 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 15:01:41.836919 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:01:41.836919 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 15:01:41.836919 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 15:01:41.836919 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 26 15:01:41.836919 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi May 26 15:01:41.836919 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:01:41.836919 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi May 26 15:01:41.836919 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:01:41.836919 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:01:41.836919 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:01:41.838028 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:01:41.838028 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:01:41.838028 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:01:41.838028 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:01:41.838028 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 15:01:41.838028 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 15:01:41.838028 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 26 15:01:41.838028 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi May 26 15:01:41.838028 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:01:41.838028 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi May 26 15:01:41.838028 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:01:41.838028 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:01:41.838028 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:01:41.838028 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:01:41.838028 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:01:41.838028 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 26 15:01:41.838028 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi May 26 15:01:41.838028 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-376a57a3-7854-4623-a07a-cc1a5df24aa5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:01:41.839020 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-376a57a3-7854-4623-a07a-cc1a5df24aa5 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012245 May 26 15:01:41.839020 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 23/47] 10.222.0.45 () {60 vars in 1190 bytes} [Thu May 26 15:01:41 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 15:01:42.721995 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-673d2196-2ee1-4e2b-b840-ee0006863299 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:42.722920 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-673d2196-2ee1-4e2b-b840-ee0006863299 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 May 26 15:01:42.723338 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 25/48] 10.222.0.45 () {56 vars in 1074 bytes} [Thu May 26 15:01:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:42.912644 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-e8aef5b0-8c4e-4790-9cd9-c3166ee19a24 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:42.918537 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.wsgi [None req-e8aef5b0-8c4e-4790-9cd9-c3166ee19a24 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 26 15:01:42.920068 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-e8aef5b0-8c4e-4790-9cd9-c3166ee19a24 admin admin] Request method failure captured: May 26 15:01:42.920068 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 26 15:01:42.920068 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: Accept: application/json May 26 15:01:42.920068 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: Accept-Encoding: gzip, deflate May 26 15:01:42.920068 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: Connection: keep-alive May 26 15:01:42.920068 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: Content-Length: 0 May 26 15:01:42.920068 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: Host: 10.222.0.45 May 26 15:01:42.920068 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: Openstack-Api-Version: compute 2.90 May 26 15:01:42.920068 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: Openstack-System-Scope: None May 26 15:01:42.920068 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: User-Agent: python-novaclient May 26 15:01:42.920068 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Auth-Token: gAAAAABij5ZWJKOlQQIhzxFagsQAH8yUdDDU8C6aKU28sanFLE4kpEdI7kWpZGU9GcFdooJ07fiXOC6gMY8R0DI_VDHQyY1lsr_asYgJAll8_lrv0rfgw4XyVKyUgvArxS9r3Ah1URc4aCPNJkmxF7Fme-4eKHQ2daMOG3bdecqk6zfDNv-lERE May 26 15:01:42.920068 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Domain-Id: None May 26 15:01:42.920068 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Domain-Name: None May 26 15:01:42.920068 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Identity-Status: Confirmed May 26 15:01:42.920068 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Is-Admin-Project: True May 26 15:01:42.920068 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Openstack-Nova-Api-Version: 2.90 May 26 15:01:42.920068 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Project-Domain-Id: default May 26 15:01:42.920068 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Project-Domain-Name: Default May 26 15:01:42.920068 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Project-Id: e013887c316445b783792ef3f307427d May 26 15:01:42.920068 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Project-Name: admin May 26 15:01:42.920068 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Role: reader,admin,member May 26 15:01:42.920068 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Roles: reader,admin,member May 26 15:01:42.921608 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e013887c316445b783792ef3f307427d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e013887c316445b783792ef3f307427d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e013887c316445b783792ef3f307427d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e013887c316445b783792ef3f307427d"}]}] May 26 15:01:42.921608 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Tenant: admin May 26 15:01:42.921608 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Tenant-Id: e013887c316445b783792ef3f307427d May 26 15:01:42.921608 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-Tenant-Name: admin May 26 15:01:42.921608 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-User: admin May 26 15:01:42.921608 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-User-Domain-Id: default May 26 15:01:42.921608 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-User-Domain-Name: Default May 26 15:01:42.921608 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-User-Id: 6cc1f206a7534d478df8987147a33502 May 26 15:01:42.921608 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: X-User-Name: admin May 26 15:01:42.921608 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: method: > May 26 15:01:42.921608 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: exception: Flavor 451 could not be found. May 26 15:01:42.921608 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: action_args: {'id': '451'} May 26 15:01:42.921608 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:01:42.921608 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:01:42.922568 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 15:01:42.922568 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 15:01:42.922568 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 15:01:42.922568 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 15:01:42.922568 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 15:01:42.922568 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 15:01:42.922568 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 15:01:42.922568 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 15:01:42.922568 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 15:01:42.922568 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:01:42.922568 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 15:01:42.922568 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 15:01:42.922568 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 26 15:01:42.922568 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi May 26 15:01:42.922568 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:01:42.922568 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi May 26 15:01:42.922568 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:01:42.922568 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:01:42.922568 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:01:42.923943 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:01:42.923943 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:01:42.923943 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:01:42.923943 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:01:42.923943 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 15:01:42.923943 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 15:01:42.923943 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 26 15:01:42.923943 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi May 26 15:01:42.923943 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:01:42.923943 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi May 26 15:01:42.923943 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:01:42.923943 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:01:42.923943 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:01:42.923943 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:01:42.923943 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:01:42.923943 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 26 15:01:42.923943 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi May 26 15:01:42.923943 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-e8aef5b0-8c4e-4790-9cd9-c3166ee19a24 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:01:42.925201 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-e8aef5b0-8c4e-4790-9cd9-c3166ee19a24 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060149 May 26 15:01:42.925201 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 24/49] 10.222.0.45 () {60 vars in 1193 bytes} [Thu May 26 15:01:42 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 15:01:42.930995 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-30fc8b0b-98ae-4be5-97d6-78cb99f2a7f9 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:42.946472 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-30fc8b0b-98ae-4be5-97d6-78cb99f2a7f9 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018993 May 26 15:01:42.947153 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 26/50] 10.222.0.45 () {60 vars in 1210 bytes} [Thu May 26 15:01:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:01:42.956879 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-f73bfe45-6674-41d8-9088-223bdbb1a39a admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:42.970069 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-f73bfe45-6674-41d8-9088-223bdbb1a39a admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016721 May 26 15:01:42.970584 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 25/51] 10.222.0.45 () {60 vars in 1210 bytes} [Thu May 26 15:01:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:01:42.979411 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-5c4a8a0c-4989-4e05-ad9b-7041ccf054ef admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:42.984767 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.wsgi [None req-5c4a8a0c-4989-4e05-ad9b-7041ccf054ef admin admin] HTTP exception thrown: Flavor 451 could not be found. May 26 15:01:42.986260 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-5c4a8a0c-4989-4e05-ad9b-7041ccf054ef admin admin] Request method failure captured: May 26 15:01:42.986260 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 26 15:01:42.986260 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: Accept: application/json May 26 15:01:42.986260 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: Accept-Encoding: gzip, deflate May 26 15:01:42.986260 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: Connection: keep-alive May 26 15:01:42.986260 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: Content-Length: 0 May 26 15:01:42.986260 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: Host: 10.222.0.45 May 26 15:01:42.986260 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: Openstack-Api-Version: compute 2.90 May 26 15:01:42.986260 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: Openstack-System-Scope: None May 26 15:01:42.986260 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: User-Agent: python-novaclient May 26 15:01:42.986260 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Auth-Token: gAAAAABij5ZWJKOlQQIhzxFagsQAH8yUdDDU8C6aKU28sanFLE4kpEdI7kWpZGU9GcFdooJ07fiXOC6gMY8R0DI_VDHQyY1lsr_asYgJAll8_lrv0rfgw4XyVKyUgvArxS9r3Ah1URc4aCPNJkmxF7Fme-4eKHQ2daMOG3bdecqk6zfDNv-lERE May 26 15:01:42.986260 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Domain-Id: None May 26 15:01:42.986260 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Domain-Name: None May 26 15:01:42.986260 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Identity-Status: Confirmed May 26 15:01:42.986260 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Is-Admin-Project: True May 26 15:01:42.986260 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Openstack-Nova-Api-Version: 2.90 May 26 15:01:42.986260 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Project-Domain-Id: default May 26 15:01:42.986260 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Project-Domain-Name: Default May 26 15:01:42.986260 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Project-Id: e013887c316445b783792ef3f307427d May 26 15:01:42.986260 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Project-Name: admin May 26 15:01:42.986260 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Role: reader,admin,member May 26 15:01:42.986260 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Roles: reader,admin,member May 26 15:01:42.987866 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e013887c316445b783792ef3f307427d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e013887c316445b783792ef3f307427d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e013887c316445b783792ef3f307427d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e013887c316445b783792ef3f307427d"}]}] May 26 15:01:42.987866 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Tenant: admin May 26 15:01:42.987866 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Tenant-Id: e013887c316445b783792ef3f307427d May 26 15:01:42.987866 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-Tenant-Name: admin May 26 15:01:42.987866 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-User: admin May 26 15:01:42.987866 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-User-Domain-Id: default May 26 15:01:42.987866 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-User-Domain-Name: Default May 26 15:01:42.987866 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-User-Id: 6cc1f206a7534d478df8987147a33502 May 26 15:01:42.987866 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: X-User-Name: admin May 26 15:01:42.987866 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: method: > May 26 15:01:42.987866 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: exception: Flavor 451 could not be found. May 26 15:01:42.987866 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: action_args: {'id': '451'} May 26 15:01:42.987866 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:01:42.987866 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:01:42.988980 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 15:01:42.988980 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 15:01:42.988980 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 15:01:42.988980 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 15:01:42.988980 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 15:01:42.988980 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 15:01:42.988980 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 15:01:42.988980 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 15:01:42.988980 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 15:01:42.988980 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:01:42.988980 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 15:01:42.988980 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 15:01:42.988980 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 26 15:01:42.988980 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi May 26 15:01:42.988980 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:01:42.988980 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi May 26 15:01:42.988980 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:01:42.988980 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:01:42.988980 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:01:42.990256 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:01:42.990256 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:01:42.990256 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:01:42.990256 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:01:42.990256 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 15:01:42.990256 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 15:01:42.990256 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 26 15:01:42.990256 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi May 26 15:01:42.990256 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:01:42.990256 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi May 26 15:01:42.990256 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:01:42.990256 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:01:42.990256 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:01:42.990256 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:01:42.990256 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:01:42.990256 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 26 15:01:42.990256 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi May 26 15:01:42.990256 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-5c4a8a0c-4989-4e05-ad9b-7041ccf054ef admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:01:42.991611 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-5c4a8a0c-4989-4e05-ad9b-7041ccf054ef admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011743 May 26 15:01:42.991611 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 27/52] 10.222.0.45 () {60 vars in 1193 bytes} [Thu May 26 15:01:42 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 15:01:43.851245 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-f73bfe45-6674-41d8-9088-223bdbb1a39a admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:43.852238 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-f73bfe45-6674-41d8-9088-223bdbb1a39a admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 May 26 15:01:43.852623 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 26/53] 10.222.0.45 () {56 vars in 1074 bytes} [Thu May 26 15:01:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:44.043450 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-840a630d-007d-40df-9274-051a13b76450 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:44.062165 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-840a630d-007d-40df-9274-051a13b76450 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.073165 May 26 15:01:44.062635 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 28/54] 10.222.0.45 () {64 vars in 1235 bytes} [Thu May 26 15:01:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 15:01:44.933202 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-f73bfe45-6674-41d8-9088-223bdbb1a39a admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:44.935068 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-f73bfe45-6674-41d8-9088-223bdbb1a39a admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002302 May 26 15:01:44.935489 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 27/55] 10.222.0.45 () {56 vars in 1074 bytes} [Thu May 26 15:01:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:45.124777 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-4aa987df-7816-420d-9360-acef003ccacd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:45.142689 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-4aa987df-7816-420d-9360-acef003ccacd admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.070374 May 26 15:01:45.143187 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 29/56] 10.222.0.45 () {64 vars in 1235 bytes} [Thu May 26 15:01:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:01:46.023734 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-f73bfe45-6674-41d8-9088-223bdbb1a39a admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:46.024729 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-f73bfe45-6674-41d8-9088-223bdbb1a39a admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 May 26 15:01:46.025120 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 28/57] 10.222.0.45 () {56 vars in 1074 bytes} [Thu May 26 15:01:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:46.219255 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-9c72f0d8-3e3e-4ecb-b18d-7a17afc27962 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:46.236894 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-9c72f0d8-3e3e-4ecb-b18d-7a17afc27962 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069425 May 26 15:01:46.237365 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 30/58] 10.222.0.45 () {64 vars in 1235 bytes} [Thu May 26 15:01:46 2022] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:01:47.106680 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-f73bfe45-6674-41d8-9088-223bdbb1a39a admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:47.107696 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-f73bfe45-6674-41d8-9088-223bdbb1a39a admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 May 26 15:01:47.108091 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 29/59] 10.222.0.45 () {56 vars in 1074 bytes} [Thu May 26 15:01:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:47.301772 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-c86a43bd-20f0-430b-be30-110e008f972c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:47.319966 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-c86a43bd-20f0-430b-be30-110e008f972c admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.070549 May 26 15:01:47.320483 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 31/60] 10.222.0.45 () {64 vars in 1235 bytes} [Thu May 26 15:01:47 2022] POST /compute/v2.1/flavors => generated 409 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:01:48.197097 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-f73bfe45-6674-41d8-9088-223bdbb1a39a admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:48.198094 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-f73bfe45-6674-41d8-9088-223bdbb1a39a admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001391 May 26 15:01:48.198490 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 30/61] 10.222.0.45 () {56 vars in 1074 bytes} [Thu May 26 15:01:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:48.389042 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-3b5e8480-00ee-452b-8cc8-167983393393 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:48.409098 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-3b5e8480-00ee-452b-8cc8-167983393393 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072826 May 26 15:01:48.409616 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 32/62] 10.222.0.45 () {60 vars in 1202 bytes} [Thu May 26 15:01:48 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:02:50.776793 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-f73bfe45-6674-41d8-9088-223bdbb1a39a admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:50.777826 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-f73bfe45-6674-41d8-9088-223bdbb1a39a admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002171 May 26 15:02:50.778218 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 31/63] 10.222.0.45 () {54 vars in 930 bytes} [Thu May 26 15:02:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:02:50.785915 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:02:50.838680 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-ee8e7d4e-a9dd-4446-8a49-ee6371f14dcf admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:50.858631 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-ee8e7d4e-a9dd-4446-8a49-ee6371f14dcf admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.074117 May 26 15:02:50.859175 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 33/64] 10.222.0.45 () {60 vars in 1291 bytes} [Thu May 26 15:02:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:02:50.879837 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writing DB stats nova_api:SELECT=14 {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:02:50.883775 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-a0e53414-cd56-4ab0-bf5b-a30e60b90249 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:50.891998 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-a0e53414-cd56-4ab0-bf5b-a30e60b90249 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013578 May 26 15:02:50.892515 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 32/65] 10.222.0.45 () {60 vars in 1282 bytes} [Thu May 26 15:02:50 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:02:50.904692 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-5e175c5f-f7c0-401c-a004-491f8025f50b admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:50.912221 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-5e175c5f-f7c0-401c-a004-491f8025f50b admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011914 May 26 15:02:50.912732 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 34/66] 10.222.0.45 () {60 vars in 1285 bytes} [Thu May 26 15:02:50 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:02:50.923573 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-c7f51455-25aa-4576-b50e-ad81d4810629 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:50.930952 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-c7f51455-25aa-4576-b50e-ad81d4810629 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010806 May 26 15:02:50.931514 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 33/67] 10.222.0.45 () {60 vars in 1285 bytes} [Thu May 26 15:02:50 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:02:50.943680 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-fa662b2a-a9f6-497f-a696-36725e84c481 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:50.951968 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-fa662b2a-a9f6-497f-a696-36725e84c481 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011740 May 26 15:02:50.952480 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 35/68] 10.222.0.45 () {60 vars in 1282 bytes} [Thu May 26 15:02:50 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:06:33.600913 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-c7f51455-25aa-4576-b50e-ad81d4810629 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:06:33.601973 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-c7f51455-25aa-4576-b50e-ad81d4810629 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 May 26 15:06:33.602417 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 34/69] 10.222.0.45 () {56 vars in 1074 bytes} [Thu May 26 15:06:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:06:33.767004 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_api:SELECT=6 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:06:33.894422 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-806b830b-a66a-4c13-a8a5-95f5370a181a admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:06:33.895729 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:06:33.895729 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: warnings.warn(msg) May 26 15:06:33.896987 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-806b830b-a66a-4c13-a8a5-95f5370a181a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:06:33.897447 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-806b830b-a66a-4c13-a8a5-95f5370a181a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:06:33.898229 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-806b830b-a66a-4c13-a8a5-95f5370a181a admin admin] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:06:33.898654 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-806b830b-a66a-4c13-a8a5-95f5370a181a admin admin] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:06:33.934027 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-806b830b-a66a-4c13-a8a5-95f5370a181a admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.168353 May 26 15:06:33.934601 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 36/70] 10.222.0.45 () {60 vars in 1193 bytes} [Thu May 26 15:06:33 2022] GET /compute/v2.1/os-services => generated 791 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:06:34.856783 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-c7f51455-25aa-4576-b50e-ad81d4810629 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:06:34.857938 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-c7f51455-25aa-4576-b50e-ad81d4810629 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 May 26 15:06:34.858328 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 35/71] 10.222.0.45 () {56 vars in 1074 bytes} [Thu May 26 15:06:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:06:35.067799 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-9177a2ad-067b-46e2-b0ca-8ac0e45778f7 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:06:35.069015 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:06:35.069015 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: warnings.warn(msg) May 26 15:06:35.070196 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-9177a2ad-067b-46e2-b0ca-8ac0e45778f7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:06:35.070635 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-9177a2ad-067b-46e2-b0ca-8ac0e45778f7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:06:35.071450 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-9177a2ad-067b-46e2-b0ca-8ac0e45778f7 admin admin] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:06:35.071875 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-9177a2ad-067b-46e2-b0ca-8ac0e45778f7 admin admin] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:06:35.092371 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-9177a2ad-067b-46e2-b0ca-8ac0e45778f7 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.091905 May 26 15:06:35.092950 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 37/72] 10.222.0.45 () {60 vars in 1193 bytes} [Thu May 26 15:06:34 2022] GET /compute/v2.1/os-services => generated 791 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:06:46.395269 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-c7f51455-25aa-4576-b50e-ad81d4810629 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:06:46.396308 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-c7f51455-25aa-4576-b50e-ad81d4810629 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 May 26 15:06:46.396706 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 36/73] 10.222.0.45 () {56 vars in 1074 bytes} [Thu May 26 15:06:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:06:46.543726 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_cell0:SELECT=4 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:06:46.544438 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_cell1:SELECT=4 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:06:46.545467 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_api:SELECT=8 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:06:46.596076 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-689b09b4-a76e-4566-9628-c20bb4173d4d admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:06:46.598089 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:06:46.598089 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: warnings.warn(msg) May 26 15:06:46.599471 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-689b09b4-a76e-4566-9628-c20bb4173d4d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:06:46.599920 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-689b09b4-a76e-4566-9628-c20bb4173d4d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:06:46.600732 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-689b09b4-a76e-4566-9628-c20bb4173d4d admin admin] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:06:46.601183 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-689b09b4-a76e-4566-9628-c20bb4173d4d admin admin] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:06:46.625979 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-689b09b4-a76e-4566-9628-c20bb4173d4d admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.086682 May 26 15:06:46.626467 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 38/74] 10.222.0.45 () {60 vars in 1193 bytes} [Thu May 26 15:06:46 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:06:47.526644 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-c7f51455-25aa-4576-b50e-ad81d4810629 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:06:47.527699 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-c7f51455-25aa-4576-b50e-ad81d4810629 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001772 May 26 15:06:47.528110 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 37/75] 10.222.0.45 () {56 vars in 1074 bytes} [Thu May 26 15:06:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:06:47.724426 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-39b0c0a7-befe-434f-9ed7-a19dcacb27a8 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:06:47.725645 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:06:47.725645 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: warnings.warn(msg) May 26 15:06:47.726855 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-39b0c0a7-befe-434f-9ed7-a19dcacb27a8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:06:47.727329 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-39b0c0a7-befe-434f-9ed7-a19dcacb27a8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:06:47.728145 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-39b0c0a7-befe-434f-9ed7-a19dcacb27a8 admin admin] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:06:47.728842 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-39b0c0a7-befe-434f-9ed7-a19dcacb27a8 admin admin] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:06:47.751152 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-39b0c0a7-befe-434f-9ed7-a19dcacb27a8 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080640 May 26 15:06:47.751733 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 39/76] 10.222.0.45 () {60 vars in 1193 bytes} [Thu May 26 15:06:47 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:07:47.403899 dv-cinder-843018-3-iscsi devstack@n-api.service[103359]: Thu May 26 15:07:47 2022 - graceful shutdown triggered... May 26 15:07:47.403216 dv-cinder-843018-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 26 15:07:47.405636 dv-cinder-843018-3-iscsi devstack@n-api.service[103360]: Gracefully killing worker 1 (pid: 103360)... May 26 15:07:47.406224 dv-cinder-843018-3-iscsi devstack@n-api.service[103361]: Gracefully killing worker 2 (pid: 103361)... May 26 15:07:48.404440 dv-cinder-843018-3-iscsi devstack@n-api.service[103359]: worker 1 buried after 1 seconds May 26 15:07:48.404440 dv-cinder-843018-3-iscsi devstack@n-api.service[103359]: worker 2 buried after 1 seconds May 26 15:07:48.404440 dv-cinder-843018-3-iscsi devstack@n-api.service[103359]: goodbye to uWSGI. May 26 15:07:48.405956 dv-cinder-843018-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 26 15:07:48.406520 dv-cinder-843018-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 26 15:07:48.409403 dv-cinder-843018-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 26 15:07:48.428916 dv-cinder-843018-3-iscsi devstack@n-api.service[117781]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 26 15:07:48.445541 dv-cinder-843018-3-iscsi devstack@n-api.service[117781]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 15:07:48 2022] *** May 26 15:07:48.445541 dv-cinder-843018-3-iscsi devstack@n-api.service[117781]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 15:07:48.445541 dv-cinder-843018-3-iscsi devstack@n-api.service[117781]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 15:07:48.445541 dv-cinder-843018-3-iscsi devstack@n-api.service[117781]: nodename: dv-cinder-843018-3-iscsi May 26 15:07:48.445541 dv-cinder-843018-3-iscsi devstack@n-api.service[117781]: machine: x86_64 May 26 15:07:48.445541 dv-cinder-843018-3-iscsi devstack@n-api.service[117781]: clock source: unix May 26 15:07:48.445541 dv-cinder-843018-3-iscsi devstack@n-api.service[117781]: pcre jit disabled May 26 15:07:48.445541 dv-cinder-843018-3-iscsi devstack@n-api.service[117781]: detected number of CPU cores: 4 May 26 15:07:48.445541 dv-cinder-843018-3-iscsi devstack@n-api.service[117781]: current working directory: / May 26 15:07:48.445541 dv-cinder-843018-3-iscsi devstack@n-api.service[117781]: detected binary path: /usr/bin/uwsgi-core May 26 15:07:48.446440 dv-cinder-843018-3-iscsi devstack@n-api.service[117781]: your processes number limit is 47680 May 26 15:07:48.446440 dv-cinder-843018-3-iscsi devstack@n-api.service[117781]: your memory page size is 4096 bytes May 26 15:07:48.446440 dv-cinder-843018-3-iscsi devstack@n-api.service[117781]: detected max file descriptor number: 2048 May 26 15:07:48.446440 dv-cinder-843018-3-iscsi devstack@n-api.service[117781]: lock engine: pthread robust mutexes May 26 15:07:48.446440 dv-cinder-843018-3-iscsi devstack@n-api.service[117781]: thunder lock: enabled May 26 15:07:48.446440 dv-cinder-843018-3-iscsi devstack@n-api.service[117781]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 26 15:07:48.446440 dv-cinder-843018-3-iscsi devstack@n-api.service[117781]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 15:07:48.501658 dv-cinder-843018-3-iscsi devstack@n-api.service[117781]: Python main interpreter initialized at 0x5588b40fd9c0 May 26 15:07:48.501658 dv-cinder-843018-3-iscsi devstack@n-api.service[117781]: python threads support enabled May 26 15:07:48.501658 dv-cinder-843018-3-iscsi devstack@n-api.service[117781]: your server socket listen backlog is limited to 100 connections May 26 15:07:48.501658 dv-cinder-843018-3-iscsi devstack@n-api.service[117781]: your mercy for graceful operations on workers is 90 seconds May 26 15:07:48.502138 dv-cinder-843018-3-iscsi devstack@n-api.service[117781]: mapped 403077 bytes (393 KB) for 2 cores May 26 15:07:48.502138 dv-cinder-843018-3-iscsi devstack@n-api.service[117781]: *** Operational MODE: preforking *** May 26 15:07:48.502364 dv-cinder-843018-3-iscsi devstack@n-api.service[117781]: *** uWSGI is running in multiple interpreter mode *** May 26 15:07:48.502364 dv-cinder-843018-3-iscsi devstack@n-api.service[117781]: spawned uWSGI master process (pid: 117781) May 26 15:07:48.503191 dv-cinder-843018-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 26 15:07:48.504056 dv-cinder-843018-3-iscsi devstack@n-api.service[117781]: spawned uWSGI worker 1 (pid: 117798, cores: 1) May 26 15:07:48.504959 dv-cinder-843018-3-iscsi devstack@n-api.service[117781]: spawned uWSGI worker 2 (pid: 117799, cores: 1) May 26 15:07:48.504959 dv-cinder-843018-3-iscsi devstack@n-api.service[117781]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 15:07:49.795853 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 15:07:49.885121 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 15:07:50.692739 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 15:07:50.692739 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: from cryptography.utils import int_from_bytes May 26 15:07:50.693109 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 15:07:50.693109 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: from cryptography.utils import int_from_bytes May 26 15:07:50.747319 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 15:07:50.747319 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: from cryptography.utils import int_from_bytes May 26 15:07:50.747873 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 15:07:50.747873 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: from cryptography.utils import int_from_bytes May 26 15:07:53.313658 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 15:07:53.314521 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 15:07:53.314521 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 15:07:53.315589 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 15:07:53.315903 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 15:07:53.316342 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.316685 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.317038 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.317349 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.317696 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.318019 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.318353 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.318681 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.319021 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.319310 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.319651 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.319999 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843018-3-iscsi {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.320315 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.320631 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.320948 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.321276 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.321588 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.321927 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.322239 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.322757 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.324494 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.325118 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.325783 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.327146 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.328460 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.328460 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.328783 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.329396 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.330002 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.331322 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.332346 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843018-3-iscsi {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.333097 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.334044 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.334614 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.335435 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.335992 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.336537 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.337134 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.337717 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.338289 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.338880 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.339517 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.340056 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.340611 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.341141 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.342490 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.342490 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.343009 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.343571 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.344294 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.344728 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.345287 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.345911 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.346492 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.347237 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.347543 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.347992 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.348636 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.349213 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.349759 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.350298 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.350834 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.351561 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.352114 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.352621 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.353214 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.353666 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.354477 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.355062 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.355702 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.356256 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.356809 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.357561 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.358870 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.359470 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.360107 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.360671 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.361243 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.362926 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.362926 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.363145 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.363611 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.364154 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.364946 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.365518 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.366031 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.366445 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.366968 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.367561 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.368144 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.368718 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.369297 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.369844 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.370389 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.370948 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.371535 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.372122 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.372701 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.373854 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.373854 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.374306 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.375228 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.375672 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.376208 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.376648 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.377099 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.378192 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.378794 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.379411 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.379964 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.380496 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.380907 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.381492 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.382015 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.382546 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.383076 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.383738 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.384259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.385054 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.385582 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.386101 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.387187 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.387187 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.387355 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.387639 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.387969 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.388296 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.388667 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.389035 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.389412 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.389796 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.390136 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.390476 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.390801 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.391140 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.391462 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.391795 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.392149 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.392494 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.392850 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.393796 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.394379 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.394773 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.395345 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.395816 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.396154 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.396496 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.396824 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.397149 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.397475 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.397805 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.398134 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.398479 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.398809 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.399243 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.399517 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.399801 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.400375 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.400717 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.401066 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.401412 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.401763 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.402371 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.402697 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.403033 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.403413 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.403820 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.404193 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.404427 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.404853 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.405208 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.405663 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.406009 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.406330 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.406886 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.407341 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.407673 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.408001 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.408359 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.408894 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.409372 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.409702 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.410033 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.410359 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.410683 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.411005 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.411370 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.411688 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.412005 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.412325 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.412669 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.412999 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.413336 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.413652 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.413996 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.414313 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.414667 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.414997 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.416505 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.416902 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.417235 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.417660 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.418024 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.418398 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.418761 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.419079 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.419435 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.419753 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.420100 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.420430 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.420750 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.421069 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.421388 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.421704 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.422036 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.422356 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.422672 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.423029 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.423471 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.423783 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.424116 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.424562 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.424890 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.425219 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.425568 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.425881 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.426238 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.426590 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.426945 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.427323 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.427680 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.428034 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.428384 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.428838 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.429214 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.429600 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.429950 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.430321 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.430670 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.431165 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.431487 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.431839 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.432227 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.432579 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.432906 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.433226 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.433550 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.433868 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.434188 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.434507 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.434824 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.435173 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.435492 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.436005 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.436491 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.436814 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.437138 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.437468 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.437785 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.438106 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.438504 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.438927 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.439294 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.439624 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.440469 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.440789 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.441339 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.441438 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.442012 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.442012 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.442940 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.442940 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.443140 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.443397 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.443759 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.444047 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.444374 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.444685 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.445003 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.445343 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.445777 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.446132 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.446484 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.446849 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.447240 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.447612 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.447970 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.448325 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.448677 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.449037 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.449363 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.449681 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.449997 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.450309 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.450631 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.450947 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.451292 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.451635 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.452697 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.453039 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.453359 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.453718 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.454049 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.454362 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.454673 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.455180 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.456084 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.456439 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.456839 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.457199 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.457495 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.457875 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.458237 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.458569 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.458944 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.459288 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.459614 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.459971 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.460292 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.460693 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.461055 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.461410 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.461768 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.462126 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.462444 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.462764 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.463226 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.463558 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.463878 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.464196 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.464546 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.464901 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.465266 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.465924 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.466307 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.466666 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.467036 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.467419 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.467746 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.468084 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.468420 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.468766 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.469084 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.469429 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.469772 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.470087 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.470406 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.470720 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.471109 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.471673 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.472046 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.472365 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.472674 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.472985 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.473299 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.473625 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.473937 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.474255 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.474568 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.474930 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.475286 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.475600 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.475911 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.476228 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.476584 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.476891 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.477238 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.477568 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.477916 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.478227 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.478603 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.478938 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.479273 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.479588 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.479897 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.480211 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.480524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.480856 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.481150 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.481521 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.481801 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.482095 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.482404 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.482720 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.483028 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.483468 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.483788 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.484098 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.484401 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.484719 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.485070 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.485382 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.485697 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.486004 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.486333 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.486703 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.487077 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.487410 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.487712 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.488024 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.488330 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.488658 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.488972 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.489278 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.489586 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.489936 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.490245 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.490591 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.490944 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.491336 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.491707 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.492043 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.492396 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.492763 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.493115 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.493465 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.493785 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.494096 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.494407 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.494715 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.495025 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.495360 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.495727 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.496043 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.496356 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.496665 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.496975 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.497322 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.497637 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.497999 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.498312 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.498632 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.498958 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.499637 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.499917 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.500301 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.500464 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.500811 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.501046 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.501416 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.501673 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.502080 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.502836 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.503181 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.503500 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.503824 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.504150 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.504479 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.504790 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.505106 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.505420 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.505736 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.506046 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.506359 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.506679 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.506993 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.507330 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.507643 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.507965 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.508271 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.508588 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.508902 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.509212 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.509536 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.509852 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.510161 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.510474 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.510781 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.511135 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.511442 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.511884 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.512201 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.512514 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.512822 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.513135 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.513451 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.513770 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.514088 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.514398 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.514823 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.515197 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.515549 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.515903 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.516245 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.516599 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.516954 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.517542 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.517799 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.518635 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.518921 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.519938 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.519938 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.520228 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.520617 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.521046 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.524308 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.524308 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.524308 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.524308 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.524308 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.524308 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.524308 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.524308 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.524996 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.524996 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.524996 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.524996 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.525563 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.525657 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.525960 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.526290 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.526624 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.526942 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.527291 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.527716 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.528048 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.528361 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.528791 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.529074 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.529326 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.529636 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.530018 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.530270 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.530808 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.530996 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.531599 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.531925 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.532247 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.532564 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.532875 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.533188 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.533544 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.533981 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.534440 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.534881 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.535389 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.535870 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.536330 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.536839 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.537287 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.537729 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.538158 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.538632 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.539207 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.539681 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.540018 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.540357 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.540699 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.541021 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.541364 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.541701 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.542025 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.542349 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.542682 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.542993 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.543331 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.543653 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.543966 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.544276 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.544586 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.544901 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.545213 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.545518 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.545824 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.546152 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.546466 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.546795 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.547171 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.547637 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.548040 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.548626 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 15:07:53.549416 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.549579 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 15:07:53.549738 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.549738 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.550018 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 15:07:53.550109 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.550183 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 15:07:53.550262 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.550402 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 15:07:53.550549 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.550680 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.550818 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.550908 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.550992 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.551101 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.551203 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.551322 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.551419 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.551504 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.551598 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.551694 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.551786 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.552437 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.552551 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.552648 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.552745 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.552840 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.552926 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.553016 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.553101 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.553192 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.553354 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.553496 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843018-3-iscsi {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.553741 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.553875 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.554101 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.554196 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.554457 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.554557 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.554783 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.555160 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.555323 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.555475 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.555603 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.555864 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.555973 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.556239 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.556409 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.556598 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.556703 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.556959 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.557050 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.557280 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.557380 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.557626 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.557720 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.557948 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.558041 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.558270 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.558395 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.558601 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.558714 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.558915 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.559016 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.559266 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.559375 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.559604 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.559760 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.559940 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.560062 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843018-3-iscsi {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.560267 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.560386 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.560582 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.560731 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.560924 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.561042 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.561199 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.561405 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.561555 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.561753 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.561920 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.562074 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.562283 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.562446 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.562601 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.562928 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.563043 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.563366 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.563524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.563741 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.563858 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.564008 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.564159 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.564299 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.564543 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.564691 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.565450 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.565605 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.565762 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.566039 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.566193 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.566470 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.566682 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.566773 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.567073 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.567246 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.567428 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.567547 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.567769 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.567889 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.568104 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.568314 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.568683 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.568787 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.568973 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.569078 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.569329 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.569594 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.569733 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.569961 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.570063 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.570468 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.570576 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.570816 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.570919 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.571081 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.571263 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.571434 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.571535 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.571785 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.571882 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.572102 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.572202 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.572417 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.572523 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.572731 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.572823 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.573055 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.573165 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.573383 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.573514 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.573697 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.573792 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.574005 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.574144 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.574329 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.574448 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.574656 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.574756 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.575206 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.575332 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.575557 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.575823 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.575924 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.576191 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.576365 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.576459 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.576657 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.576823 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.576918 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.577004 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.577260 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.577441 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.577644 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.577985 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.578092 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.578308 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.578640 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.578745 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.578841 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.578945 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.579041 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.579381 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.579665 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.579759 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.579832 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.579902 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.580034 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.580206 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.580407 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.581382 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.581607 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.581709 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.581783 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.581902 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.582259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.582395 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.582680 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.582790 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.583029 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.583165 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.583375 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.583469 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.583691 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.583793 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.584005 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.584099 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.584325 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.584417 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.584637 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.584741 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.584949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.585089 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.585262 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.585361 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.585574 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.585666 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.585887 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.585986 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.586241 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.586390 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.586687 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.586777 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.587016 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.587131 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.587363 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.587589 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.587692 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.587946 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.588048 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.588325 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.588471 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.588654 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.588825 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.588966 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.589127 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.589276 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.589450 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.589600 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.589761 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.589916 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.590087 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.590245 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.590405 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.590563 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.590721 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.590878 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.591055 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.591256 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.591396 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.591647 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.591745 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.592027 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.592121 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.592345 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.592485 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.592660 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.592805 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.592988 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.593083 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.593300 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.593416 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.593613 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.593748 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.593936 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.594029 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.594252 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.594353 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.594569 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.594662 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.594883 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.594975 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.595227 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.595339 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.595546 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.595640 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.595861 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.595968 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.596203 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.596341 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.596524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.596743 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.597021 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.597123 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.597343 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.597436 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.597660 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.597761 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.597976 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.598085 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.598292 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.598385 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.598603 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.598702 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.598914 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.599016 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:07:53.599258 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.599365 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.599606 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.599699 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.599929 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.600033 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.600249 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.600348 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.600600 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.600724 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.600919 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.601059 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.601259 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.601528 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.601625 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.601849 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.601960 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.602166 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.602260 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.602482 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.602610 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.602803 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.602939 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.603141 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.603249 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.603478 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.603582 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.603793 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.603894 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.604171 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.604272 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.604533 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.604641 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.604853 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.604958 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.605181 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.605275 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.605499 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.605608 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.605826 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.605926 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.606154 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.606250 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.606470 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.606578 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.606799 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.606891 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.607137 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.607232 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.607473 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.607585 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.607821 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.607954 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.608155 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.608319 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.608513 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.608674 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.608844 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.608976 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.609180 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.609322 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.609537 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.609631 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.609861 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.609990 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.610188 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.610282 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.610506 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.610600 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.610818 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.610919 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.611153 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.611251 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.611469 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.611571 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.611854 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.612008 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.612177 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.612399 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.612508 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.612795 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.612925 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.613111 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.613214 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.613467 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.613584 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.613779 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.613950 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.614088 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.614213 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.614403 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.614617 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.614700 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.614980 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.615139 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.615331 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.615495 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.615646 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.615765 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.616014 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.616217 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.616344 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.616476 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.616624 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.616768 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.616907 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.617052 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.617308 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.617455 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.617609 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.617762 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.617870 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.617981 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.618227 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.618341 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.618596 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.618720 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.618912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.619017 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.619259 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.619356 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.619579 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.619680 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.619922 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.620066 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.620276 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.620374 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.620644 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.620780 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.620944 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.621079 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.621279 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.621460 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.621599 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.621820 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.621924 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.622171 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.622280 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.622527 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.622629 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.622838 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.622929 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.623187 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.623300 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.623509 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.623603 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.623829 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.623922 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.624176 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.624350 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.624489 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.624623 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.624811 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.624983 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.625134 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.625255 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.625432 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.625580 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.625772 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.625902 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.626111 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.626205 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.626438 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.626573 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.626776 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.626899 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.627167 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.627792 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.628070 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.628258 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.628421 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.628577 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.628728 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.628894 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.629100 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.629214 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.629420 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.629514 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.629735 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.629829 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.630056 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.630256 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.630358 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.630431 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.630687 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.630781 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.631000 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.631147 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.631337 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.631433 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.631649 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.631749 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.631980 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.632082 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.632335 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.632429 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.632652 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.632810 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.633003 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.633321 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.633429 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.633695 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.633892 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.634037 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 15:07:53.634132 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.634426 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.634784 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.635152 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.635500 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.635827 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.636162 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.636503 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.636828 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.637170 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.637524 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.637891 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.638213 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.638563 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.638907 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.639284 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.639623 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.639956 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.640271 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.640613 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.640977 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.641340 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.641676 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.642013 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.642426 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.642775 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.643926 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.644311 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.644636 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.644960 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.645290 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.645612 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.645968 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.646410 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.646753 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.647128 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.647478 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.647790 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.648139 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.648473 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.648907 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.649304 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.649607 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.649941 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.650519 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.650866 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.651232 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.651580 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.651932 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.652264 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.652591 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.652911 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.653259 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.653578 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.653899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.654218 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.654552 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.654869 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.655229 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.655585 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.655905 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.656235 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.656587 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.656915 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.657228 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.657575 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.657898 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.658230 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.658615 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.659146 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.659507 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.659829 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.660145 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.660472 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.660807 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.661125 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.661451 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.661772 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.662136 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.662466 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.662812 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.663169 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.663494 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.663954 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.664159 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.664478 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.664827 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.665147 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.665467 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.665787 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.666101 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.666446 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.666867 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.667488 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.667832 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.668182 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.668526 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.668865 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.669192 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.669530 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.669867 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.670215 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.670529 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.670859 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.671183 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.671500 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.671817 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.672131 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.672443 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.672756 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.673099 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.673443 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.673784 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.674177 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.674574 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.675252 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.675352 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.675658 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.676021 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.676334 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.676660 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.676975 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.677288 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.677602 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.677954 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.678269 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.678613 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.678948 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.679323 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.679638 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.679967 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.680313 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.680625 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.680936 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.681249 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.681636 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.682029 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.682343 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.682664 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.682983 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.683367 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.683720 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.684085 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.684465 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.684700 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.685044 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.685384 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.685842 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.686033 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.686372 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.694329 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.694329 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.694329 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.694329 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.694329 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.694329 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.694329 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.694329 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.695027 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.695027 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.695027 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.695027 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.695027 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.695027 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.695027 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.695027 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.695618 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.695618 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.695618 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.695618 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.695618 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.695618 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.695618 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.695618 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.696148 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.696148 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.696148 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.696148 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.696414 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.696725 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.696899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.697091 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO dbcounter [None req-dd71ee1a-f59b-453f-b61a-821c6f3100cd None None] Registered counter for database nova_api May 26 15:07:53.697234 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.697568 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.697916 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.698618 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.698618 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.698912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.699299 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.699627 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.700015 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.700332 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.700655 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.700985 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.701309 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.701652 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.701975 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.702289 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.702612 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.702930 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.703302 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.709359 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.709359 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.709359 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.709359 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.709359 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.709359 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.709359 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.709359 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.709963 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.709963 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.709963 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.709963 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.709963 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.709963 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.709963 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.709963 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.710541 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.710541 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.710541 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.710541 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.710807 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.711954 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.711954 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.711954 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.711954 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.712268 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.712590 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.712905 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.714131 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.714131 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.714131 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.714827 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.714827 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.715341 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.715568 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.715836 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.716081 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.716426 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.716730 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.717184 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.717516 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.717820 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.718141 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.718448 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.718760 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.718964 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_db.sqlalchemy.engines [None req-dd71ee1a-f59b-453f-b61a-821c6f3100cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117799) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 15:07:53.719724 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.719724 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.720034 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.720196 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.720383 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.720774 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.721262 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.721695 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.722191 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.722446 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.722765 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.723220 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.723547 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.723868 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.724201 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.724533 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.725247 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.725247 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.725581 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.725795 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.726129 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.726462 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.726787 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.727204 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.727497 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.727614 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writer thread running {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 15:07:53.727927 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.728247 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.728624 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.729042 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.729453 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.729988 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.730433 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.730637 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.730932 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.731305 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.731658 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.731981 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.732303 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.732639 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.732639 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.732639 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.734101 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.734101 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.735051 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.735051 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.735051 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.735721 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.735883 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.736240 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.736579 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.737462 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.737805 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.738124 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.738508 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.738832 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.739173 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.739531 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.739969 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.740342 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.740500 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.740970 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.741320 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.741688 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.742008 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.742592 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.742848 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.743029 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.743384 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.743721 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.744069 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.744371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.744693 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.745011 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.745375 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.745700 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.746020 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.746382 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.746675 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.746959 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.747326 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.747639 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.747968 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.748288 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.748600 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.748912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.749249 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.749799 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.749947 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.750474 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.750671 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.750954 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.751318 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.751641 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.751971 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.752330 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.753426 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.753658 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.754366 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.754366 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.754529 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.754766 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.755122 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.755456 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.755755 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.756086 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.756716 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.756999 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.757329 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.757668 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.758020 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.758360 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.758713 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.759048 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.759393 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.759727 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.760054 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.760388 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.760725 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.761059 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.761404 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.761729 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.762048 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.762369 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.762688 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.763062 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.763448 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.763762 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.764114 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.764440 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.764761 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.765079 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.765423 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.765750 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.766066 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.766381 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.766703 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.767022 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.767449 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.767805 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.768228 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.768581 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.768903 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.769225 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.769548 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.770134 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.770464 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.770822 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.771182 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.771560 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.771883 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.772216 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.772553 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.772869 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.773183 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.773501 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.773819 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.774161 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.774491 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.774810 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.775394 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.775730 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.776041 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.776620 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.776980 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.777307 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.777639 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.777983 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.778316 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.778628 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.778959 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.779299 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.779616 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.779937 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.780257 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.780571 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.781832 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.781832 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.781832 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.781832 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.782354 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.782430 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.782780 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.783068 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.783404 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.783937 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.784282 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.785063 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.785063 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.785282 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.785611 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.785936 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.786311 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.786619 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.786898 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.787249 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.787578 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.787912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.788283 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.788625 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.context [None req-dd71ee1a-f59b-453f-b61a-821c6f3100cd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),adff5b13-26db-46a1-a2eb-c66025319ac2(cell1) {{(pid=117799) load_cells /opt/stack/nova/nova/context.py:464}} May 26 15:07:53.788792 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.788974 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.789320 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.789558 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.789919 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.790257 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.790577 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.790896 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.791318 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.791640 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.792218 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.792559 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.792824 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dd71ee1a-f59b-453f-b61a-821c6f3100cd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:07:53.792966 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.793215 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.793550 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.793888 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.794214 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.794412 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dd71ee1a-f59b-453f-b61a-821c6f3100cd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:07:53.794575 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.794876 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.795245 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.795387 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dd71ee1a-f59b-453f-b61a-821c6f3100cd None None] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:07:53.795583 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.795888 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.796224 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.796547 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.796867 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.797210 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.797390 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dd71ee1a-f59b-453f-b61a-821c6f3100cd None None] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:07:53.797585 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.797834 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.798171 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.798489 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.798804 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.799658 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.800055 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.800220 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO dbcounter [None req-dd71ee1a-f59b-453f-b61a-821c6f3100cd None None] Registered counter for database nova_cell0 May 26 15:07:53.800410 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.800410 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.801047 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.801382 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.801705 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.802019 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.802436 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.802767 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.803145 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.803434 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.803770 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.804093 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.804393 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO dbcounter [None req-dd71ee1a-f59b-453f-b61a-821c6f3100cd None None] Registered counter for database nova_cell1 May 26 15:07:53.804478 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.804841 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.805193 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.805517 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.806743 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.806743 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.806743 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.807006 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.807267 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.807588 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.808072 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.808271 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.808593 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.808922 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.809263 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.809576 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.809889 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.810202 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.810523 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.810852 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.811213 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.811531 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.811846 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.812303 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.812507 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_db.sqlalchemy.engines [None req-dd71ee1a-f59b-453f-b61a-821c6f3100cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117799) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 15:07:53.812857 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.813451 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.814113 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.814644 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.815850 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_db.sqlalchemy.engines [None req-dd71ee1a-f59b-453f-b61a-821c6f3100cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117799) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 15:07:53.816064 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.816439 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.817037 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.817641 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.818231 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.818813 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.819440 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.820040 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.820627 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.821230 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.821814 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.822414 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.823008 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.823692 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.824334 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.824952 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.825576 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.825753 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writer thread running {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 15:07:53.826237 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.826826 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.827450 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.827611 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writer thread running {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 15:07:53.828069 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.828796 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.829283 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.829886 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.830557 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.831179 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.831785 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.832386 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.832981 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.833565 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.834170 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.834796 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.835448 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.836039 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.836665 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.837266 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.837892 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.838507 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.839135 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.839751 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.840348 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.840942 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.841554 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.842146 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.842752 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.843395 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.844007 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.844633 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.845261 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.845860 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.846520 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.847164 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.847833 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.848437 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.849096 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.849725 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.850322 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.850922 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.851544 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:07:53.852003 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 15:07:53.942653 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO dbcounter [None req-da46a4f0-05e2-4a76-81df-b62fe9a2dbcc None None] Registered counter for database nova_api May 26 15:07:53.963997 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_db.sqlalchemy.engines [None req-da46a4f0-05e2-4a76-81df-b62fe9a2dbcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117798) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 15:07:53.972522 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writer thread running {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 15:07:53.981460 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO dbcounter [None req-dd71ee1a-f59b-453f-b61a-821c6f3100cd None None] Registered counter for database nova_cell0 May 26 15:07:53.989602 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_db.sqlalchemy.engines [None req-dd71ee1a-f59b-453f-b61a-821c6f3100cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117799) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 15:07:53.994475 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writer thread running {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 15:07:54.038720 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.context [None req-da46a4f0-05e2-4a76-81df-b62fe9a2dbcc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),adff5b13-26db-46a1-a2eb-c66025319ac2(cell1) {{(pid=117798) load_cells /opt/stack/nova/nova/context.py:464}} May 26 15:07:54.043148 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-da46a4f0-05e2-4a76-81df-b62fe9a2dbcc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:07:54.044927 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-da46a4f0-05e2-4a76-81df-b62fe9a2dbcc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:07:54.045940 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-da46a4f0-05e2-4a76-81df-b62fe9a2dbcc None None] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:07:54.049263 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-da46a4f0-05e2-4a76-81df-b62fe9a2dbcc None None] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:07:54.052033 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO dbcounter [None req-da46a4f0-05e2-4a76-81df-b62fe9a2dbcc None None] Registered counter for database nova_cell0 May 26 15:07:54.056272 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO dbcounter [None req-da46a4f0-05e2-4a76-81df-b62fe9a2dbcc None None] Registered counter for database nova_cell1 May 26 15:07:54.064406 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_db.sqlalchemy.engines [None req-da46a4f0-05e2-4a76-81df-b62fe9a2dbcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117798) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 15:07:54.068930 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_db.sqlalchemy.engines [None req-da46a4f0-05e2-4a76-81df-b62fe9a2dbcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117798) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 15:07:54.073464 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writer thread running {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 15:07:54.223625 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writer thread running {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 15:07:54.234367 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO dbcounter [None req-da46a4f0-05e2-4a76-81df-b62fe9a2dbcc None None] Registered counter for database nova_cell0 May 26 15:07:54.244438 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_db.sqlalchemy.engines [None req-da46a4f0-05e2-4a76-81df-b62fe9a2dbcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117798) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 15:07:54.249244 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writer thread running {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 15:07:54.339874 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: WARNING keystonemiddleware.auth_token [None req-dd71ee1a-f59b-453f-b61a-821c6f3100cd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 15:07:54.346834 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: WARNING keystonemiddleware.auth_token [None req-dd71ee1a-f59b-453f-b61a-821c6f3100cd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 15:07:54.599461 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: WARNING keystonemiddleware.auth_token [None req-da46a4f0-05e2-4a76-81df-b62fe9a2dbcc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 15:07:54.607631 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: WARNING keystonemiddleware.auth_token [None req-da46a4f0-05e2-4a76-81df-b62fe9a2dbcc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 15:07:54.702393 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: WARNING keystonemiddleware.auth_token [None req-dd71ee1a-f59b-453f-b61a-821c6f3100cd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 15:07:54.710320 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: WARNING keystonemiddleware.auth_token [None req-dd71ee1a-f59b-453f-b61a-821c6f3100cd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 15:07:54.715956 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5588b40fd9c0 pid: 117799 (default app) May 26 15:07:54.969101 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: WARNING keystonemiddleware.auth_token [None req-da46a4f0-05e2-4a76-81df-b62fe9a2dbcc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 15:07:54.976114 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: WARNING keystonemiddleware.auth_token [None req-da46a4f0-05e2-4a76-81df-b62fe9a2dbcc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 15:07:54.981509 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5588b40fd9c0 pid: 117798 (default app) May 26 15:08:37.745800 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_api:SELECT=3 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:37.746620 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=3 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:37.747592 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell0:SELECT=3 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:37.748456 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell0:SELECT=3 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:39.083682 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-d3a19694-7daa-4a04-aad5-cfbd9cf8416c tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] Action: 'create', calling method: .version_select at 0x7ffb5febeca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-718417346"}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:08:40.004813 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-d3a19694-7daa-4a04-aad5-cfbd9cf8416c tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.269169 May 26 15:08:40.005800 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 1/1] 10.222.0.45 () {60 vars in 1154 bytes} [Thu May 26 15:08:37 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2272 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 26 15:08:40.396855 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a1417dd8-ddd1-4cc5-a1b6-6ff362eff2f3 tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] Calling method '.version_select at 0x7ffb5fe845e0>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:40.429858 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=3 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:40.430804 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=3 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:40.432060 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=3 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:40.433009 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=3 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:40.760469 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a1417dd8-ddd1-4cc5-a1b6-6ff362eff2f3 tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/71796c28-6491-406c-a034-f1d1b6d123ef" status: 200 len: 344 microversion: 2.1 time: 0.745062 May 26 15:08:40.761597 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 1/2] 10.222.0.45 () {58 vars in 1244 bytes} [Thu May 26 15:08:40 2022] GET /compute/v2.1/os-volumes/71796c28-6491-406c-a034-f1d1b6d123ef => generated 344 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:08:41.778589 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-3e87b94e-863b-4253-abff-f7c1c8ac66a9 tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] Calling method '.version_select at 0x7ffb5fd10c10>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:41.871508 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-3e87b94e-863b-4253-abff-f7c1c8ac66a9 tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/71796c28-6491-406c-a034-f1d1b6d123ef" status: 200 len: 345 microversion: 2.1 time: 0.101461 May 26 15:08:41.872139 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 2/3] 10.222.0.45 () {58 vars in 1244 bytes} [Thu May 26 15:08:41 2022] GET /compute/v2.1/os-volumes/71796c28-6491-406c-a034-f1d1b6d123ef => generated 345 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:08:41.877663 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-26385b5c-456f-4f31-9942-6456324c3bb5 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-489598016", "imageRef": "5b5a68b4-38e3-4f05-b97f-4339d6752e34", "flavorRef": "452", "networks": [{"uuid": "6993e895-ff19-4148-8b89-9136c7bb582e"}]}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:08:41.883810 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-01987702-3538-41a4-afb5-d45f1f8acdef tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] Action: 'create', calling method: .version_select at 0x7ffb5fd10e50>, body: {"snapshot": {"volume_id": "71796c28-6491-406c-a034-f1d1b6d123ef", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-573570346"}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:08:41.989808 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.network.neutron [None req-26385b5c-456f-4f31-9942-6456324c3bb5 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] validate_networks() for [('6993e895-ff19-4148-8b89-9136c7bb582e', None, None, None, None, None)] {{(pid=117798) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:08:42.277388 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-01987702-3538-41a4-afb5-d45f1f8acdef tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] 10.222.0.45 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.397233 May 26 15:08:42.277966 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 3/4] 10.222.0.45 () {60 vars in 1161 bytes} [Thu May 26 15:08:41 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:08:42.288468 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-a0ff809f-408c-4228-a11b-8eb7fa6e7b48 tempest-VolumesTestJSON-204116498 tempest-VolumesTestJSON-204116498-project] Calling method '.version_select at 0x7ffb5fd258b0>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:42.406916 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-a0ff809f-408c-4228-a11b-8eb7fa6e7b48 tempest-VolumesTestJSON-204116498 tempest-VolumesTestJSON-204116498-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/05f449a2-4ac6-495e-9439-ad0f869ab279" status: 200 len: 351 microversion: 2.1 time: 0.127686 May 26 15:08:42.416007 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 4/5] 10.222.0.45 () {58 vars in 1244 bytes} [Thu May 26 15:08:42 2022] GET /compute/v2.1/os-volumes/05f449a2-4ac6-495e-9439-ad0f869ab279 => generated 351 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:08:42.423048 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-956c4844-ee7c-4043-ace8-5589f3ac9b3a tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] Calling method '.version_select at 0x7ffb5fd31040>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:42.569637 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-956c4844-ee7c-4043-ace8-5589f3ac9b3a tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/6e966fee-6302-47e0-967c-2cba524309c5" status: 200 len: 286 microversion: 2.1 time: 0.151537 May 26 15:08:42.570376 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 5/6] 10.222.0.45 () {58 vars in 1250 bytes} [Thu May 26 15:08:42 2022] GET /compute/v2.1/os-snapshots/6e966fee-6302-47e0-967c-2cba524309c5 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:08:42.584533 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-caeab700-4ed0-40c5-a209-3b4dd7bbc2a8 tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] Calling method '.version_select at 0x7ffb5fd25c10>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:42.646885 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-caeab700-4ed0-40c5-a209-3b4dd7bbc2a8 tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.067745 May 26 15:08:42.654494 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 6/7] 10.222.0.45 () {58 vars in 1139 bytes} [Thu May 26 15:08:42 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:08:42.661683 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-ec1be532-a4be-47d3-ac55-099f73aeffe6 tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] Calling method '.version_select at 0x7ffb5fd10dc0>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:42.706740 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-ec1be532-a4be-47d3-ac55-099f73aeffe6 tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/6e966fee-6302-47e0-967c-2cba524309c5" status: 200 len: 286 microversion: 2.1 time: 0.050098 May 26 15:08:42.707630 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 7/8] 10.222.0.45 () {58 vars in 1250 bytes} [Thu May 26 15:08:42 2022] GET /compute/v2.1/os-snapshots/6e966fee-6302-47e0-967c-2cba524309c5 => generated 286 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:08:43.723912 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-c8013a0d-8a55-450b-b5af-9f5691458f1d tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] Calling method '.version_select at 0x7ffb5fd31310>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:43.787644 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-c8013a0d-8a55-450b-b5af-9f5691458f1d tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/6e966fee-6302-47e0-967c-2cba524309c5" status: 200 len: 286 microversion: 2.1 time: 0.071655 May 26 15:08:43.789191 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 8/9] 10.222.0.45 () {58 vars in 1250 bytes} [Thu May 26 15:08:43 2022] GET /compute/v2.1/os-snapshots/6e966fee-6302-47e0-967c-2cba524309c5 => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:08:44.801720 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-2088a7c6-857b-4bca-979b-81bb4f44d295 tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] Calling method '.version_select at 0x7ffb5fd109d0>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:44.855461 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-2088a7c6-857b-4bca-979b-81bb4f44d295 tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/6e966fee-6302-47e0-967c-2cba524309c5" status: 200 len: 286 microversion: 2.1 time: 0.058149 May 26 15:08:44.859936 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 9/10] 10.222.0.45 () {58 vars in 1250 bytes} [Thu May 26 15:08:44 2022] GET /compute/v2.1/os-snapshots/6e966fee-6302-47e0-967c-2cba524309c5 => generated 286 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:08:45.370346 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-26385b5c-456f-4f31-9942-6456324c3bb5 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Flavor limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:08:45.371649 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-26385b5c-456f-4f31-9942-6456324c3bb5 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Image limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:08:45.372313 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-26385b5c-456f-4f31-9942-6456324c3bb5 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Flavor pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:08:45.372906 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-26385b5c-456f-4f31-9942-6456324c3bb5 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Image pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:08:45.373682 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-26385b5c-456f-4f31-9942-6456324c3bb5 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:08:45.429290 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-26385b5c-456f-4f31-9942-6456324c3bb5 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:08:45.430702 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-26385b5c-456f-4f31-9942-6456324c3bb5 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:08:45.433374 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-26385b5c-456f-4f31-9942-6456324c3bb5 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:08:45.434037 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-26385b5c-456f-4f31-9942-6456324c3bb5 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:08:45.553824 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-26385b5c-456f-4f31-9942-6456324c3bb5 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Getting quotas for project 39490fef872043d1bfef791dd0bbb5a5. Resources: {'cores', 'ram', 'instances'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:08:45.586729 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-26385b5c-456f-4f31-9942-6456324c3bb5 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Getting quotas for user 3b7a1284bc044e51923c72a9f8f41d95 and project 39490fef872043d1bfef791dd0bbb5a5. Resources: {'cores', 'ram', 'instances'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:08:45.610387 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-26385b5c-456f-4f31-9942-6456324c3bb5 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Going to run 1 instances... {{(pid=117798) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:08:45.618428 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-26385b5c-456f-4f31-9942-6456324c3bb5 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5b5a68b4-38e3-4f05-b97f-4339d6752e34',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:08:45.789978 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-26385b5c-456f-4f31-9942-6456324c3bb5 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.013583 May 26 15:08:45.790627 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 2/11] 10.222.0.45 () {60 vars in 1146 bytes} [Thu May 26 15:08:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 4015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 15:08:45.802902 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-f1523216-3d10-426c-ba42-a6c6dfd4d771 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:45.804291 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-f1523216-3d10-426c-ba42-a6c6dfd4d771 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:08:45.869165 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-109e99a1-1bc4-4d4c-a771-c593309fb88d tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] Calling method '.version_select at 0x7ffb5f41d790>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:45.944656 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-109e99a1-1bc4-4d4c-a771-c593309fb88d tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/6e966fee-6302-47e0-967c-2cba524309c5" status: 200 len: 286 microversion: 2.1 time: 0.080686 May 26 15:08:45.945535 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 3/12] 10.222.0.45 () {58 vars in 1250 bytes} [Thu May 26 15:08:45 2022] GET /compute/v2.1/os-snapshots/6e966fee-6302-47e0-967c-2cba524309c5 => generated 286 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:08:46.147167 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-f1523216-3d10-426c-ba42-a6c6dfd4d771 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a1284bc044e51923c72a9f8f41d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39490fef872043d1bfef791dd0bbb5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:08:46.183735 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-f1523216-3d10-426c-ba42-a6c6dfd4d771 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 200 len: 1214 microversion: 2.1 time: 0.386244 May 26 15:08:46.184914 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 10/13] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:08:45 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 1214 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:08:46.956608 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-4e8f683d-7b25-43a8-a7c4-6b9d8348fb1e tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] Calling method '.version_select at 0x7ffb5f41dee0>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:47.046430 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-4e8f683d-7b25-43a8-a7c4-6b9d8348fb1e tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/6e966fee-6302-47e0-967c-2cba524309c5" status: 200 len: 286 microversion: 2.1 time: 0.093674 May 26 15:08:47.046967 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 4/14] 10.222.0.45 () {58 vars in 1250 bytes} [Thu May 26 15:08:46 2022] GET /compute/v2.1/os-snapshots/6e966fee-6302-47e0-967c-2cba524309c5 => generated 286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:08:47.201970 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-ffef6cc0-847a-4d72-9fe1-0caf6a331da7 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:47.202578 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-ffef6cc0-847a-4d72-9fe1-0caf6a331da7 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:08:47.460365 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-ffef6cc0-847a-4d72-9fe1-0caf6a331da7 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a1284bc044e51923c72a9f8f41d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39490fef872043d1bfef791dd0bbb5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:08:47.471186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-ffef6cc0-847a-4d72-9fe1-0caf6a331da7 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 200 len: 1214 microversion: 2.1 time: 0.273119 May 26 15:08:47.481913 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 11/15] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:08:47 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 1214 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:08:48.058340 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-62621c64-9238-4f91-9049-e07df101eb4d tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] Calling method '.version_select at 0x7ffb5f4375e0>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:48.110790 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-62621c64-9238-4f91-9049-e07df101eb4d tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/6e966fee-6302-47e0-967c-2cba524309c5" status: 200 len: 286 microversion: 2.1 time: 0.056204 May 26 15:08:48.111429 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 5/16] 10.222.0.45 () {58 vars in 1250 bytes} [Thu May 26 15:08:48 2022] GET /compute/v2.1/os-snapshots/6e966fee-6302-47e0-967c-2cba524309c5 => generated 286 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:08:48.489395 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-5a00f4e2-5a91-4008-8274-2a064a98d76d tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:48.490059 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-5a00f4e2-5a91-4008-8274-2a064a98d76d tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:08:48.508371 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5a00f4e2-5a91-4008-8274-2a064a98d76d tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:08:48.508833 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5a00f4e2-5a91-4008-8274-2a064a98d76d tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:08:48.509737 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5a00f4e2-5a91-4008-8274-2a064a98d76d tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:08:48.510180 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5a00f4e2-5a91-4008-8274-2a064a98d76d tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:08:49.122680 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b01df9dc-f05a-4535-b692-3836e175d1bd tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] Calling method '.version_select at 0x7ffb5f41dc10>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:49.133251 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-5a00f4e2-5a91-4008-8274-2a064a98d76d tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a1284bc044e51923c72a9f8f41d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39490fef872043d1bfef791dd0bbb5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:08:49.169646 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-5a00f4e2-5a91-4008-8274-2a064a98d76d tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 200 len: 1210 microversion: 2.1 time: 0.684698 May 26 15:08:49.170265 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 12/17] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:08:48 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 1210 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:08:49.196117 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b01df9dc-f05a-4535-b692-3836e175d1bd tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/6e966fee-6302-47e0-967c-2cba524309c5" status: 200 len: 287 microversion: 2.1 time: 0.078111 May 26 15:08:49.196860 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 6/18] 10.222.0.45 () {58 vars in 1250 bytes} [Thu May 26 15:08:49 2022] GET /compute/v2.1/os-snapshots/6e966fee-6302-47e0-967c-2cba524309c5 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:08:49.208193 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-e87afd11-3b4f-4432-961e-186f51f43ae6 tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] Calling method '.version_select at 0x7ffb5fc78820>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:49.373150 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-e87afd11-3b4f-4432-961e-186f51f43ae6 tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] 10.222.0.45 "DELETE /compute/v2.1/os-snapshots/6e966fee-6302-47e0-967c-2cba524309c5" status: 202 len: 0 microversion: 2.1 time: 0.169508 May 26 15:08:49.374319 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 13/19] 10.222.0.45 () {58 vars in 1253 bytes} [Thu May 26 15:08:49 2022] DELETE /compute/v2.1/os-snapshots/6e966fee-6302-47e0-967c-2cba524309c5 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:08:49.391593 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e8b12fb2-69cb-44b3-8034-608465e09a29 tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] Calling method '.version_select at 0x7ffb5f41d280>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:49.482006 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e8b12fb2-69cb-44b3-8034-608465e09a29 tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/6e966fee-6302-47e0-967c-2cba524309c5" status: 200 len: 286 microversion: 2.1 time: 0.101796 May 26 15:08:49.483026 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 7/20] 10.222.0.45 () {58 vars in 1250 bytes} [Thu May 26 15:08:49 2022] GET /compute/v2.1/os-snapshots/6e966fee-6302-47e0-967c-2cba524309c5 => generated 286 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:08:49.748715 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-7c767501-8017-4dcc-9a82-a9809e2b0958 tempest-VolumesTestJSON-204116498 tempest-VolumesTestJSON-204116498-project] Calling method '.version_select at 0x7ffb5fc78790>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:49.854214 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-7c767501-8017-4dcc-9a82-a9809e2b0958 tempest-VolumesTestJSON-204116498 tempest-VolumesTestJSON-204116498-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/9737ff80-2168-47d3-9fc6-bb55faea7172" status: 200 len: 351 microversion: 2.1 time: 0.109326 May 26 15:08:49.860661 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 14/21] 10.222.0.45 () {58 vars in 1244 bytes} [Thu May 26 15:08:49 2022] GET /compute/v2.1/os-volumes/9737ff80-2168-47d3-9fc6-bb55faea7172 => generated 351 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:08:50.190070 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e0320421-c29e-41e0-949a-52319663811b tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:50.191365 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e0320421-c29e-41e0-949a-52319663811b tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:08:50.224559 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e0320421-c29e-41e0-949a-52319663811b tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:08:50.225630 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e0320421-c29e-41e0-949a-52319663811b tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:08:50.228341 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e0320421-c29e-41e0-949a-52319663811b tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:08:50.228965 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e0320421-c29e-41e0-949a-52319663811b tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:08:50.481770 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e0320421-c29e-41e0-949a-52319663811b tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a1284bc044e51923c72a9f8f41d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39490fef872043d1bfef791dd0bbb5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:08:50.494855 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-b0ad5750-63c3-4bae-84b7-409998f96fd7 tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] Calling method '.version_select at 0x7ffb5fc784c0>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:50.520617 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e0320421-c29e-41e0-949a-52319663811b tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 200 len: 1272 microversion: 2.1 time: 0.332699 May 26 15:08:50.521412 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 8/22] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:08:50 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 1272 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:08:50.543207 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.wsgi [None req-b0ad5750-63c3-4bae-84b7-409998f96fd7 tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] HTTP exception thrown: Snapshot 6e966fee-6302-47e0-967c-2cba524309c5 could not be found. May 26 15:08:50.552019 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-b0ad5750-63c3-4bae-84b7-409998f96fd7 tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] Request method failure captured: May 26 15:08:50.552019 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: request: GET /compute/v2.1/os-snapshots/6e966fee-6302-47e0-967c-2cba524309c5 HTTP/1.1 May 26 15:08:50.552019 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept: application/json May 26 15:08:50.552019 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept-Encoding: identity May 26 15:08:50.552019 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Connection: close May 26 15:08:50.552019 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Length: 0 May 26 15:08:50.552019 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Type: application/json May 26 15:08:50.552019 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Host: 10.222.0.45 May 26 15:08:50.552019 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Openstack-System-Scope: None May 26 15:08:50.552019 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: User-Agent: python-urllib3/1.26.9 May 26 15:08:50.552019 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Auth-Token: gAAAAABij5f1WUAJ1nW8vS45LAw37ffPS0dVU6Wh66sqgolLqQGDZaJKmtYtglvK5cAfMfNIp1E_7ctU55X-zhPJEq43h1gjDSyQ160Xl7ZtSVKKvOvX1Yi5EyKb2mKw4RgNsFyDKM_FE-eNxZoTeEILTDX4NYpqRX7Ez0CYezzLrZeuyskPKEk May 26 15:08:50.552019 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Id: None May 26 15:08:50.552019 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Name: None May 26 15:08:50.552019 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Identity-Status: Confirmed May 26 15:08:50.552019 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Is-Admin-Project: True May 26 15:08:50.552019 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Id: default May 26 15:08:50.552019 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Name: Default May 26 15:08:50.552019 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Id: c05d2d0c2652419a97189c0a5d55892c May 26 15:08:50.552019 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-618241930 May 26 15:08:50.552019 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Role: reader,member May 26 15:08:50.552019 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Roles: reader,member May 26 15:08:50.553033 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c05d2d0c2652419a97189c0a5d55892c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c05d2d0c2652419a97189c0a5d55892c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c05d2d0c2652419a97189c0a5d55892c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c05d2d0c2652419a97189c0a5d55892c"}]}] May 26 15:08:50.553033 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant: tempest-VolumesSnapshotsTestJSON-618241930 May 26 15:08:50.553033 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Id: c05d2d0c2652419a97189c0a5d55892c May 26 15:08:50.553033 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-618241930 May 26 15:08:50.553033 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User: tempest-VolumesSnapshotsTestJSON-618241930-project May 26 15:08:50.553033 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Id: default May 26 15:08:50.553033 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Name: Default May 26 15:08:50.553033 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Id: fb6aefbbf3a143e394e3b568371c060f May 26 15:08:50.553033 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Name: tempest-VolumesSnapshotsTestJSON-618241930-project May 26 15:08:50.553033 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: method: May 26 15:08:50.553033 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: exception: Snapshot 6e966fee-6302-47e0-967c-2cba524309c5 could not be found. May 26 15:08:50.553033 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: action_args: {'id': '6e966fee-6302-47e0-967c-2cba524309c5'} May 26 15:08:50.553033 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:08:50.553753 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:50.553753 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 26 15:08:50.553753 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 26 15:08:50.553753 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 26 15:08:50.553753 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 26 15:08:50.553753 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 26 15:08:50.553753 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 26 15:08:50.553753 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 15:08:50.553753 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 15:08:50.553753 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 15:08:50.553753 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 15:08:50.553753 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 15:08:50.553753 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 15:08:50.553753 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 15:08:50.553753 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 15:08:50.553753 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6e966fee-6302-47e0-967c-2cba524309c5 could not be found. (HTTP 404) (Request-ID: req-fa54633f-f12e-4353-b02f-34f078bb5a51) May 26 15:08:50.553753 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:08:50.553753 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:08:50.554586 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:08:50.554586 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:50.554586 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 26 15:08:50.554586 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 26 15:08:50.554586 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 15:08:50.554586 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 15:08:50.554586 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 26 15:08:50.554586 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 26 15:08:50.554586 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 15:08:50.554586 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 15:08:50.554586 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 26 15:08:50.554586 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 26 15:08:50.554586 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 26 15:08:50.554586 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 26 15:08:50.554586 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 26 15:08:50.554586 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 26 15:08:50.554586 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 15:08:50.554586 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 15:08:50.554586 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 15:08:50.555484 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 15:08:50.555484 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 15:08:50.555484 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 15:08:50.555484 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 15:08:50.555484 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 15:08:50.555484 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6e966fee-6302-47e0-967c-2cba524309c5 could not be found. May 26 15:08:50.555484 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:08:50.555484 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:08:50.555484 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:08:50.555484 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:50.555484 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:08:50.555484 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:08:50.555484 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:08:50.555484 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:08:50.555484 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 15:08:50.555484 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 15:08:50.555484 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:08:50.555484 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:08:50.555484 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 26 15:08:50.555484 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:08:50.556400 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6e966fee-6302-47e0-967c-2cba524309c5 could not be found. May 26 15:08:50.556400 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:08:50.556400 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:08:50.556400 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:08:50.556400 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:50.556400 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:08:50.556400 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:08:50.556400 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:08:50.556400 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:08:50.556400 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6e966fee-6302-47e0-967c-2cba524309c5 could not be found. May 26 15:08:50.556400 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:08:50.556400 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-b0ad5750-63c3-4bae-84b7-409998f96fd7 tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] Returning 404 to user: Snapshot 6e966fee-6302-47e0-967c-2cba524309c5 could not be found. {{(pid=117799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:08:50.556400 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-b0ad5750-63c3-4bae-84b7-409998f96fd7 tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/6e966fee-6302-47e0-967c-2cba524309c5" status: 404 len: 111 microversion: 2.1 time: 0.062793 May 26 15:08:50.557887 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 15/23] 10.222.0.45 () {58 vars in 1250 bytes} [Thu May 26 15:08:50 2022] GET /compute/v2.1/os-snapshots/6e966fee-6302-47e0-967c-2cba524309c5 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:08:50.565845 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a3023dc0-2128-41e1-aadd-72313f3a8b4f tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] Calling method '.version_select at 0x7ffb5eb624c0>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:50.724561 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a3023dc0-2128-41e1-aadd-72313f3a8b4f tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/71796c28-6491-406c-a034-f1d1b6d123ef" status: 202 len: 0 microversion: 2.1 time: 0.163196 May 26 15:08:50.728128 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 9/24] 10.222.0.45 () {58 vars in 1247 bytes} [Thu May 26 15:08:50 2022] DELETE /compute/v2.1/os-volumes/71796c28-6491-406c-a034-f1d1b6d123ef => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:08:50.738462 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-c83bacda-d2f2-4436-bf7a-066dc2c7567f tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] Calling method '.version_select at 0x7ffb606a1280>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:50.840638 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-c83bacda-d2f2-4436-bf7a-066dc2c7567f tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/71796c28-6491-406c-a034-f1d1b6d123ef" status: 200 len: 344 microversion: 2.1 time: 0.108061 May 26 15:08:50.842434 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 16/25] 10.222.0.45 () {58 vars in 1244 bytes} [Thu May 26 15:08:50 2022] GET /compute/v2.1/os-volumes/71796c28-6491-406c-a034-f1d1b6d123ef => generated 344 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:08:51.544744 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f3706b8d-545a-4c90-8004-f61cfb7b035c tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:51.546054 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f3706b8d-545a-4c90-8004-f61cfb7b035c tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:08:51.562545 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f3706b8d-545a-4c90-8004-f61cfb7b035c tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:08:51.566736 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f3706b8d-545a-4c90-8004-f61cfb7b035c tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:08:51.568879 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f3706b8d-545a-4c90-8004-f61cfb7b035c tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:08:51.569719 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f3706b8d-545a-4c90-8004-f61cfb7b035c tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:08:51.585825 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-853fa034-bc5e-4ae6-96d0-eab158d5b260 tempest-VolumesTestJSON-204116498 tempest-VolumesTestJSON-204116498-project] Calling method '.version_select at 0x7ffb5fbfe310>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:51.715858 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f3706b8d-545a-4c90-8004-f61cfb7b035c tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a1284bc044e51923c72a9f8f41d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39490fef872043d1bfef791dd0bbb5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:08:51.737125 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f3706b8d-545a-4c90-8004-f61cfb7b035c tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 200 len: 1272 microversion: 2.1 time: 0.200688 May 26 15:08:51.737653 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 10/26] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:08:51 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 1272 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:08:51.755826 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-853fa034-bc5e-4ae6-96d0-eab158d5b260 tempest-VolumesTestJSON-204116498 tempest-VolumesTestJSON-204116498-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/dfb6cb39-ecb5-415c-9bf5-d4df609a865f" status: 200 len: 351 microversion: 2.1 time: 0.174212 May 26 15:08:51.763953 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 17/27] 10.222.0.45 () {58 vars in 1244 bytes} [Thu May 26 15:08:51 2022] GET /compute/v2.1/os-volumes/dfb6cb39-ecb5-415c-9bf5-d4df609a865f => generated 351 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:08:51.769410 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f7769bd5-6dfa-4c3f-ba38-189f7bc94a1e tempest-VolumesTestJSON-204116498 tempest-VolumesTestJSON-204116498-project] Calling method '.version_select at 0x7ffb5eb428b0>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:51.855121 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-889abd0f-2a65-40b1-aef4-ce2f0f17f6e2 tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] Calling method '.version_select at 0x7ffb5fbfea60>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:51.949440 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f7769bd5-6dfa-4c3f-ba38-189f7bc94a1e tempest-VolumesTestJSON-204116498 tempest-VolumesTestJSON-204116498-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.184623 May 26 15:08:51.951604 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 11/28] 10.222.0.45 () {58 vars in 1133 bytes} [Thu May 26 15:08:51 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:08:51.962460 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.wsgi [None req-889abd0f-2a65-40b1-aef4-ce2f0f17f6e2 tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] HTTP exception thrown: Volume 71796c28-6491-406c-a034-f1d1b6d123ef could not be found. May 26 15:08:51.964859 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-889abd0f-2a65-40b1-aef4-ce2f0f17f6e2 tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] Request method failure captured: May 26 15:08:51.964859 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: request: GET /compute/v2.1/os-volumes/71796c28-6491-406c-a034-f1d1b6d123ef HTTP/1.1 May 26 15:08:51.964859 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept: application/json May 26 15:08:51.964859 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept-Encoding: identity May 26 15:08:51.964859 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Connection: close May 26 15:08:51.964859 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Length: 0 May 26 15:08:51.964859 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Type: application/json May 26 15:08:51.964859 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Host: 10.222.0.45 May 26 15:08:51.964859 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Openstack-System-Scope: None May 26 15:08:51.964859 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: User-Agent: python-urllib3/1.26.9 May 26 15:08:51.964859 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Auth-Token: gAAAAABij5f1WUAJ1nW8vS45LAw37ffPS0dVU6Wh66sqgolLqQGDZaJKmtYtglvK5cAfMfNIp1E_7ctU55X-zhPJEq43h1gjDSyQ160Xl7ZtSVKKvOvX1Yi5EyKb2mKw4RgNsFyDKM_FE-eNxZoTeEILTDX4NYpqRX7Ez0CYezzLrZeuyskPKEk May 26 15:08:51.964859 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Id: None May 26 15:08:51.964859 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Name: None May 26 15:08:51.964859 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Identity-Status: Confirmed May 26 15:08:51.964859 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Is-Admin-Project: True May 26 15:08:51.964859 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Id: default May 26 15:08:51.964859 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Name: Default May 26 15:08:51.964859 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Id: c05d2d0c2652419a97189c0a5d55892c May 26 15:08:51.964859 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-618241930 May 26 15:08:51.964859 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Role: reader,member May 26 15:08:51.964859 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Roles: reader,member May 26 15:08:51.966199 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c05d2d0c2652419a97189c0a5d55892c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c05d2d0c2652419a97189c0a5d55892c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c05d2d0c2652419a97189c0a5d55892c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c05d2d0c2652419a97189c0a5d55892c"}]}] May 26 15:08:51.966199 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant: tempest-VolumesSnapshotsTestJSON-618241930 May 26 15:08:51.966199 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Id: c05d2d0c2652419a97189c0a5d55892c May 26 15:08:51.966199 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-618241930 May 26 15:08:51.966199 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User: tempest-VolumesSnapshotsTestJSON-618241930-project May 26 15:08:51.966199 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Id: default May 26 15:08:51.966199 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Name: Default May 26 15:08:51.966199 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Id: fb6aefbbf3a143e394e3b568371c060f May 26 15:08:51.966199 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Name: tempest-VolumesSnapshotsTestJSON-618241930-project May 26 15:08:51.966199 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: method: May 26 15:08:51.966199 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: exception: Volume 71796c28-6491-406c-a034-f1d1b6d123ef could not be found. May 26 15:08:51.966199 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: action_args: {'id': '71796c28-6491-406c-a034-f1d1b6d123ef'} May 26 15:08:51.966199 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:08:51.966949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:51.966949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 15:08:51.966949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 15:08:51.966949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 15:08:51.966949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 15:08:51.966949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 15:08:51.966949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 15:08:51.966949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 15:08:51.966949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 15:08:51.966949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 15:08:51.966949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 15:08:51.966949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 15:08:51.966949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 15:08:51.966949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 15:08:51.966949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 15:08:51.966949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 71796c28-6491-406c-a034-f1d1b6d123ef could not be found. (HTTP 404) (Request-ID: req-f8ef0f51-4b4e-40b5-85fe-48f27cae195c) May 26 15:08:51.966949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:08:51.966949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:08:51.966949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:08:51.969426 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:51.969426 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 15:08:51.969426 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 15:08:51.969426 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 15:08:51.969426 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 15:08:51.969426 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 15:08:51.969426 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 15:08:51.969426 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 15:08:51.969426 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 15:08:51.969426 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 15:08:51.969426 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 15:08:51.969426 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 15:08:51.969426 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 15:08:51.969426 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 15:08:51.969426 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 15:08:51.969426 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 15:08:51.969426 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 15:08:51.969426 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 15:08:51.969426 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 15:08:51.972313 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 15:08:51.972313 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 15:08:51.972313 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 15:08:51.972313 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 15:08:51.972313 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 71796c28-6491-406c-a034-f1d1b6d123ef could not be found. May 26 15:08:51.972313 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:08:51.972313 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:08:51.972313 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:08:51.972313 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:51.972313 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:08:51.972313 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:08:51.972313 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:08:51.972313 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:08:51.972313 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 15:08:51.972313 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 15:08:51.972313 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:08:51.972313 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:08:51.972313 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 15:08:51.972313 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:08:51.975705 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 71796c28-6491-406c-a034-f1d1b6d123ef could not be found. May 26 15:08:51.975705 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:08:51.975705 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:08:51.975705 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:08:51.975705 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:51.975705 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:08:51.975705 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:08:51.975705 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:08:51.975705 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:08:51.975705 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 71796c28-6491-406c-a034-f1d1b6d123ef could not be found. May 26 15:08:51.975705 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:08:51.975705 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-889abd0f-2a65-40b1-aef4-ce2f0f17f6e2 tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] Returning 404 to user: Volume 71796c28-6491-406c-a034-f1d1b6d123ef could not be found. {{(pid=117799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:08:51.975705 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-889abd0f-2a65-40b1-aef4-ce2f0f17f6e2 tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/71796c28-6491-406c-a034-f1d1b6d123ef" status: 404 len: 109 microversion: 2.1 time: 0.115352 May 26 15:08:51.975705 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 18/29] 10.222.0.45 () {58 vars in 1244 bytes} [Thu May 26 15:08:51 2022] GET /compute/v2.1/os-volumes/71796c28-6491-406c-a034-f1d1b6d123ef => generated 109 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:08:51.978018 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ef8af39b-c0d4-45b4-822e-cb3e82da0eed tempest-VolumesTestJSON-204116498 tempest-VolumesTestJSON-204116498-project] Calling method '.version_select at 0x7ffb5eb1b4c0>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:51.978978 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-02979ab9-0346-40e4-b7fb-d334bfe1dd8b tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] Calling method '.version_select at 0x7ffb5fbfeb80>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:52.064548 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.wsgi [None req-02979ab9-0346-40e4-b7fb-d334bfe1dd8b tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] HTTP exception thrown: Volume 71796c28-6491-406c-a034-f1d1b6d123ef could not be found. May 26 15:08:52.066891 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-02979ab9-0346-40e4-b7fb-d334bfe1dd8b tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] Request method failure captured: May 26 15:08:52.066891 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: request: DELETE /compute/v2.1/os-volumes/71796c28-6491-406c-a034-f1d1b6d123ef HTTP/1.1 May 26 15:08:52.066891 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept: application/json May 26 15:08:52.066891 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept-Encoding: identity May 26 15:08:52.066891 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Connection: close May 26 15:08:52.066891 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Length: 0 May 26 15:08:52.066891 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Type: application/json May 26 15:08:52.066891 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Host: 10.222.0.45 May 26 15:08:52.066891 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Openstack-System-Scope: None May 26 15:08:52.066891 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: User-Agent: python-urllib3/1.26.9 May 26 15:08:52.066891 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Auth-Token: gAAAAABij5f1WUAJ1nW8vS45LAw37ffPS0dVU6Wh66sqgolLqQGDZaJKmtYtglvK5cAfMfNIp1E_7ctU55X-zhPJEq43h1gjDSyQ160Xl7ZtSVKKvOvX1Yi5EyKb2mKw4RgNsFyDKM_FE-eNxZoTeEILTDX4NYpqRX7Ez0CYezzLrZeuyskPKEk May 26 15:08:52.066891 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Id: None May 26 15:08:52.066891 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Name: None May 26 15:08:52.066891 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Identity-Status: Confirmed May 26 15:08:52.066891 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Is-Admin-Project: True May 26 15:08:52.066891 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Id: default May 26 15:08:52.066891 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Name: Default May 26 15:08:52.066891 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Id: c05d2d0c2652419a97189c0a5d55892c May 26 15:08:52.066891 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-618241930 May 26 15:08:52.066891 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Role: reader,member May 26 15:08:52.066891 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Roles: reader,member May 26 15:08:52.068394 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c05d2d0c2652419a97189c0a5d55892c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c05d2d0c2652419a97189c0a5d55892c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c05d2d0c2652419a97189c0a5d55892c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c05d2d0c2652419a97189c0a5d55892c"}]}] May 26 15:08:52.068394 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant: tempest-VolumesSnapshotsTestJSON-618241930 May 26 15:08:52.068394 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Id: c05d2d0c2652419a97189c0a5d55892c May 26 15:08:52.068394 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-618241930 May 26 15:08:52.068394 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User: tempest-VolumesSnapshotsTestJSON-618241930-project May 26 15:08:52.068394 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Id: default May 26 15:08:52.068394 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Name: Default May 26 15:08:52.068394 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Id: fb6aefbbf3a143e394e3b568371c060f May 26 15:08:52.068394 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Name: tempest-VolumesSnapshotsTestJSON-618241930-project May 26 15:08:52.068394 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: method: May 26 15:08:52.068394 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: exception: Volume 71796c28-6491-406c-a034-f1d1b6d123ef could not be found. May 26 15:08:52.068394 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: action_args: {'id': '71796c28-6491-406c-a034-f1d1b6d123ef'} May 26 15:08:52.068394 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:08:52.069204 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:52.069204 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 15:08:52.069204 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 15:08:52.069204 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 15:08:52.069204 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 15:08:52.069204 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 15:08:52.069204 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 15:08:52.069204 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 15:08:52.069204 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 15:08:52.069204 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 15:08:52.069204 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 15:08:52.069204 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 15:08:52.069204 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 15:08:52.069204 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 15:08:52.069204 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 15:08:52.069204 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 71796c28-6491-406c-a034-f1d1b6d123ef could not be found. (HTTP 404) (Request-ID: req-96ad0dda-fd97-4276-b22b-e30b136855a9) May 26 15:08:52.069204 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:08:52.069204 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:08:52.069204 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:08:52.070497 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:52.070497 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 15:08:52.070497 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 15:08:52.070497 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 15:08:52.070497 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 15:08:52.070497 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 15:08:52.070497 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 15:08:52.070497 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 15:08:52.070497 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 15:08:52.070497 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 15:08:52.070497 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 15:08:52.070497 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 15:08:52.070497 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 15:08:52.070497 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 15:08:52.070497 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 15:08:52.070497 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 15:08:52.070497 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 15:08:52.070497 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 15:08:52.070497 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 15:08:52.071494 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 15:08:52.071494 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 15:08:52.071494 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 15:08:52.071494 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 15:08:52.071494 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 71796c28-6491-406c-a034-f1d1b6d123ef could not be found. May 26 15:08:52.071494 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:08:52.071494 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:08:52.071494 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:08:52.071494 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:52.071494 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:08:52.071494 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:08:52.071494 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:08:52.071494 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:08:52.071494 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 15:08:52.071494 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 15:08:52.071494 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:08:52.071494 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:08:52.071494 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 15:08:52.071494 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:08:52.072605 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 71796c28-6491-406c-a034-f1d1b6d123ef could not be found. May 26 15:08:52.072605 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:08:52.072605 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:08:52.072605 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:08:52.072605 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:52.072605 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:08:52.072605 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:08:52.072605 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:08:52.072605 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:08:52.072605 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 71796c28-6491-406c-a034-f1d1b6d123ef could not be found. May 26 15:08:52.072605 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:08:52.074944 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-02979ab9-0346-40e4-b7fb-d334bfe1dd8b tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] Returning 404 to user: Volume 71796c28-6491-406c-a034-f1d1b6d123ef could not be found. {{(pid=117799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:08:52.076010 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-02979ab9-0346-40e4-b7fb-d334bfe1dd8b tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/71796c28-6491-406c-a034-f1d1b6d123ef" status: 404 len: 109 microversion: 2.1 time: 0.101703 May 26 15:08:52.076825 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 19/30] 10.222.0.45 () {58 vars in 1247 bytes} [Thu May 26 15:08:51 2022] DELETE /compute/v2.1/os-volumes/71796c28-6491-406c-a034-f1d1b6d123ef => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:08:52.086696 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-c0abd702-ca81-4e48-a0d0-72cd5ec7ab73 tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] Calling method '.version_select at 0x7ffb5fc781f0>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:52.121879 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.wsgi [None req-c0abd702-ca81-4e48-a0d0-72cd5ec7ab73 tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] HTTP exception thrown: Volume 71796c28-6491-406c-a034-f1d1b6d123ef could not be found. May 26 15:08:52.124156 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-c0abd702-ca81-4e48-a0d0-72cd5ec7ab73 tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] Request method failure captured: May 26 15:08:52.124156 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: request: GET /compute/v2.1/os-volumes/71796c28-6491-406c-a034-f1d1b6d123ef HTTP/1.1 May 26 15:08:52.124156 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept: application/json May 26 15:08:52.124156 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept-Encoding: identity May 26 15:08:52.124156 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Connection: close May 26 15:08:52.124156 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Length: 0 May 26 15:08:52.124156 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Type: application/json May 26 15:08:52.124156 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Host: 10.222.0.45 May 26 15:08:52.124156 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Openstack-System-Scope: None May 26 15:08:52.124156 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: User-Agent: python-urllib3/1.26.9 May 26 15:08:52.124156 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Auth-Token: gAAAAABij5f1WUAJ1nW8vS45LAw37ffPS0dVU6Wh66sqgolLqQGDZaJKmtYtglvK5cAfMfNIp1E_7ctU55X-zhPJEq43h1gjDSyQ160Xl7ZtSVKKvOvX1Yi5EyKb2mKw4RgNsFyDKM_FE-eNxZoTeEILTDX4NYpqRX7Ez0CYezzLrZeuyskPKEk May 26 15:08:52.124156 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Id: None May 26 15:08:52.124156 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Name: None May 26 15:08:52.124156 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Identity-Status: Confirmed May 26 15:08:52.124156 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Is-Admin-Project: True May 26 15:08:52.124156 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Id: default May 26 15:08:52.124156 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Name: Default May 26 15:08:52.124156 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Id: c05d2d0c2652419a97189c0a5d55892c May 26 15:08:52.124156 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-618241930 May 26 15:08:52.124156 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Role: reader,member May 26 15:08:52.124156 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Roles: reader,member May 26 15:08:52.125312 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c05d2d0c2652419a97189c0a5d55892c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c05d2d0c2652419a97189c0a5d55892c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c05d2d0c2652419a97189c0a5d55892c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c05d2d0c2652419a97189c0a5d55892c"}]}] May 26 15:08:52.125312 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant: tempest-VolumesSnapshotsTestJSON-618241930 May 26 15:08:52.125312 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Id: c05d2d0c2652419a97189c0a5d55892c May 26 15:08:52.125312 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-618241930 May 26 15:08:52.125312 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User: tempest-VolumesSnapshotsTestJSON-618241930-project May 26 15:08:52.125312 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Id: default May 26 15:08:52.125312 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Name: Default May 26 15:08:52.125312 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Id: fb6aefbbf3a143e394e3b568371c060f May 26 15:08:52.125312 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Name: tempest-VolumesSnapshotsTestJSON-618241930-project May 26 15:08:52.125312 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: method: May 26 15:08:52.125312 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: exception: Volume 71796c28-6491-406c-a034-f1d1b6d123ef could not be found. May 26 15:08:52.125312 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: action_args: {'id': '71796c28-6491-406c-a034-f1d1b6d123ef'} May 26 15:08:52.125312 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:08:52.127139 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:52.127139 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 15:08:52.127139 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 15:08:52.127139 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 15:08:52.127139 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 15:08:52.127139 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 15:08:52.127139 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 15:08:52.127139 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 15:08:52.127139 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 15:08:52.127139 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 15:08:52.127139 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 15:08:52.127139 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 15:08:52.127139 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 15:08:52.127139 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 15:08:52.127139 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 15:08:52.127139 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 71796c28-6491-406c-a034-f1d1b6d123ef could not be found. (HTTP 404) (Request-ID: req-d551227a-02ff-4c9a-8da5-2b8a108ff66f) May 26 15:08:52.127139 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:08:52.127139 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:08:52.127139 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:08:52.128181 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:52.128181 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 15:08:52.128181 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 15:08:52.128181 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 15:08:52.128181 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 15:08:52.128181 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 15:08:52.128181 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 15:08:52.128181 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 15:08:52.128181 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 15:08:52.128181 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 15:08:52.128181 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 15:08:52.128181 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 15:08:52.128181 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 15:08:52.128181 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 15:08:52.128181 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 15:08:52.128181 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 15:08:52.128181 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 15:08:52.128181 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 15:08:52.128181 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 15:08:52.129243 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 15:08:52.129243 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 15:08:52.129243 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 15:08:52.129243 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 15:08:52.129243 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 71796c28-6491-406c-a034-f1d1b6d123ef could not be found. May 26 15:08:52.129243 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:08:52.129243 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:08:52.129243 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:08:52.129243 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:52.129243 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:08:52.129243 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:08:52.129243 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:08:52.129243 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:08:52.129243 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 15:08:52.129243 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 15:08:52.129243 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:08:52.129243 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:08:52.129243 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 15:08:52.129243 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:08:52.130395 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 71796c28-6491-406c-a034-f1d1b6d123ef could not be found. May 26 15:08:52.130395 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:08:52.130395 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:08:52.130395 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:08:52.130395 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:52.130395 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:08:52.130395 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:08:52.130395 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:08:52.130395 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:08:52.130395 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 71796c28-6491-406c-a034-f1d1b6d123ef could not be found. May 26 15:08:52.130395 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:08:52.132040 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-c0abd702-ca81-4e48-a0d0-72cd5ec7ab73 tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] Returning 404 to user: Volume 71796c28-6491-406c-a034-f1d1b6d123ef could not be found. {{(pid=117799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:08:52.133058 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-c0abd702-ca81-4e48-a0d0-72cd5ec7ab73 tempest-VolumesSnapshotsTestJSON-618241930 tempest-VolumesSnapshotsTestJSON-618241930-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/71796c28-6491-406c-a034-f1d1b6d123ef" status: 404 len: 109 microversion: 2.1 time: 0.051601 May 26 15:08:52.137603 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 20/31] 10.222.0.45 () {58 vars in 1244 bytes} [Thu May 26 15:08:52 2022] GET /compute/v2.1/os-volumes/71796c28-6491-406c-a034-f1d1b6d123ef => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:08:52.240299 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ef8af39b-c0d4-45b4-822e-cb3e82da0eed tempest-VolumesTestJSON-204116498 tempest-VolumesTestJSON-204116498-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.279065 May 26 15:08:52.248220 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 12/32] 10.222.0.45 () {58 vars in 1148 bytes} [Thu May 26 15:08:51 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:08:52.255485 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-9e46e869-dd61-4b89-8a7b-9df19e6978e2 tempest-VolumesTestJSON-204116498 tempest-VolumesTestJSON-204116498-project] Calling method '.version_select at 0x7ffb5fbfe670>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:52.578213 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-9e46e869-dd61-4b89-8a7b-9df19e6978e2 tempest-VolumesTestJSON-204116498 tempest-VolumesTestJSON-204116498-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.327535 May 26 15:08:52.578859 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 21/33] 10.222.0.45 () {58 vars in 1133 bytes} [Thu May 26 15:08:52 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:08:52.605789 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-13d6d32b-a887-456b-b2bf-c94533a04f58 tempest-VolumesTestJSON-204116498 tempest-VolumesTestJSON-204116498-project] Calling method '.version_select at 0x7ffb5eb24d30>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:52.756616 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-43a8f983-d5f5-447b-b53f-41482ab4601d tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:52.757145 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-43a8f983-d5f5-447b-b53f-41482ab4601d tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:08:52.784323 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-43a8f983-d5f5-447b-b53f-41482ab4601d tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:08:52.784691 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-43a8f983-d5f5-447b-b53f-41482ab4601d tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:08:52.785494 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-43a8f983-d5f5-447b-b53f-41482ab4601d tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:08:52.785933 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-43a8f983-d5f5-447b-b53f-41482ab4601d tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:08:52.915483 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-13d6d32b-a887-456b-b2bf-c94533a04f58 tempest-VolumesTestJSON-204116498 tempest-VolumesTestJSON-204116498-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.328071 May 26 15:08:52.916056 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 13/34] 10.222.0.45 () {58 vars in 1166 bytes} [Thu May 26 15:08:52 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:08:52.929311 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-9c4fb61b-1e26-44e6-b2b8-cf3ff58d1396 tempest-VolumesTestJSON-204116498 tempest-VolumesTestJSON-204116498-project] Calling method '.version_select at 0x7ffb5eb1b790>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:53.119190 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-9c4fb61b-1e26-44e6-b2b8-cf3ff58d1396 tempest-VolumesTestJSON-204116498 tempest-VolumesTestJSON-204116498-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.194237 May 26 15:08:53.119784 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 14/35] 10.222.0.45 () {58 vars in 1169 bytes} [Thu May 26 15:08:52 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:08:53.131880 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-43a8f983-d5f5-447b-b53f-41482ab4601d tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a1284bc044e51923c72a9f8f41d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39490fef872043d1bfef791dd0bbb5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:08:53.136632 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d4444694-1784-4057-b49f-d3c81c4544e5 tempest-VolumesTestJSON-204116498 tempest-VolumesTestJSON-204116498-project] Calling method '.version_select at 0x7ffb5eb551f0>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:53.139287 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-43a8f983-d5f5-447b-b53f-41482ab4601d tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 200 len: 1272 microversion: 2.1 time: 0.386586 May 26 15:08:53.139863 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 22/36] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:08:52 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 1272 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:08:53.334904 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-d4444694-1784-4057-b49f-d3c81c4544e5 tempest-VolumesTestJSON-204116498 tempest-VolumesTestJSON-204116498-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.202547 May 26 15:08:53.335636 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 15/37] 10.222.0.45 () {58 vars in 1154 bytes} [Thu May 26 15:08:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:08:53.348331 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-e044185e-eee0-4263-8975-9b3fc05f70c2 tempest-VolumesTestJSON-204116498 tempest-VolumesTestJSON-204116498-project] Calling method '.version_select at 0x7ffb5fb90d30>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:53.551910 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-e044185e-eee0-4263-8975-9b3fc05f70c2 tempest-VolumesTestJSON-204116498 tempest-VolumesTestJSON-204116498-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.208112 May 26 15:08:53.552226 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 23/38] 10.222.0.45 () {58 vars in 1187 bytes} [Thu May 26 15:08:53 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:08:53.569806 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a18558a2-6c03-4d0a-9550-91eeec89adf4 tempest-VolumesTestJSON-204116498 tempest-VolumesTestJSON-204116498-project] Calling method '.version_select at 0x7ffb5eb24550>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:53.826295 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a18558a2-6c03-4d0a-9550-91eeec89adf4 tempest-VolumesTestJSON-204116498 tempest-VolumesTestJSON-204116498-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.266107 May 26 15:08:53.828087 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 16/39] 10.222.0.45 () {58 vars in 1154 bytes} [Thu May 26 15:08:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:08:54.158927 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-b422019b-9b8c-4243-aa3c-24364c303a8f tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:54.159723 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-b422019b-9b8c-4243-aa3c-24364c303a8f tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:08:54.173551 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b422019b-9b8c-4243-aa3c-24364c303a8f tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:08:54.174123 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b422019b-9b8c-4243-aa3c-24364c303a8f tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:08:54.174971 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b422019b-9b8c-4243-aa3c-24364c303a8f tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:08:54.175422 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b422019b-9b8c-4243-aa3c-24364c303a8f tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:08:54.439833 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-b422019b-9b8c-4243-aa3c-24364c303a8f tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a1284bc044e51923c72a9f8f41d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39490fef872043d1bfef791dd0bbb5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:08:54.455558 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-b422019b-9b8c-4243-aa3c-24364c303a8f tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 200 len: 1272 microversion: 2.1 time: 0.297113 May 26 15:08:54.456478 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 24/40] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:08:54 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 1272 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:08:55.476849 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-022e0657-1d5b-4fb9-91a3-e597bb549825 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:55.478097 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-022e0657-1d5b-4fb9-91a3-e597bb549825 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:08:55.480466 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=2 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:55.488112 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-022e0657-1d5b-4fb9-91a3-e597bb549825 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:08:55.489605 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-022e0657-1d5b-4fb9-91a3-e597bb549825 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:08:55.490767 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-022e0657-1d5b-4fb9-91a3-e597bb549825 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:08:55.491573 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-022e0657-1d5b-4fb9-91a3-e597bb549825 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:08:55.596092 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=6 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:56.489461 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-022e0657-1d5b-4fb9-91a3-e597bb549825 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a1284bc044e51923c72a9f8f41d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39490fef872043d1bfef791dd0bbb5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:08:56.503317 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-022e0657-1d5b-4fb9-91a3-e597bb549825 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 200 len: 1314 microversion: 2.1 time: 1.026935 May 26 15:08:56.504159 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 17/41] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:08:55 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 1314 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:08:57.465341 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell0:SELECT=4 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:57.488865 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-5d8d6ea4-9517-4b97-bbda-3b8113935165 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Action: 'create', calling method: .version_select at 0x7ffb5fb90040>, body: {"keypair": {"name": "tempest-keypair-1782266556", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0yJ5M1ZFaYklhpAoeXrnWscnanIWkBWLmyVeHojqS3fdBE3scTSaETBrYdOra2t/9ApZM27gqARLhX4Y19nRQ5S58HYXuxFznAy14ZaLFm3c47MVyuyO7oCgp5z+q8jA=="}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:08:57.523704 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f9c97637-6264-455c-b1c6-6621affabb01 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:57.525423 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f9c97637-6264-455c-b1c6-6621affabb01 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:08:57.558526 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f9c97637-6264-455c-b1c6-6621affabb01 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:08:57.568713 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f9c97637-6264-455c-b1c6-6621affabb01 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:08:57.575076 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f9c97637-6264-455c-b1c6-6621affabb01 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:08:57.577666 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f9c97637-6264-455c-b1c6-6621affabb01 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:08:57.725653 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.quota [None req-5d8d6ea4-9517-4b97-bbda-3b8113935165 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Getting quotas for project 85ea8fbf32d748a8ad70996a9fa12843. Resources: {'key_pairs'} {{(pid=117799) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:08:57.759382 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.quota [None req-5d8d6ea4-9517-4b97-bbda-3b8113935165 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Getting quotas for user 9a671e0538ca45bbb44c298f1aa13a37 and project 85ea8fbf32d748a8ad70996a9fa12843. Resources: {'key_pairs'} {{(pid=117799) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:08:57.919334 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-5d8d6ea4-9517-4b97-bbda-3b8113935165 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.924318 May 26 15:08:57.923732 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 25/42] 10.222.0.45 () {60 vars in 1158 bytes} [Thu May 26 15:08:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:08:58.534600 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f9c97637-6264-455c-b1c6-6621affabb01 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a1284bc044e51923c72a9f8f41d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39490fef872043d1bfef791dd0bbb5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:08:58.543197 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f9c97637-6264-455c-b1c6-6621affabb01 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 200 len: 1314 microversion: 2.1 time: 1.026817 May 26 15:08:58.567995 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 18/43] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:08:57 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 1314 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:08:59.528161 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-c92c51a0-0fcf-4ea2-b2b1-e4f275dc2164 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Action: 'create', calling method: .version_select at 0x7ffb5fb7c160>, body: {"keypair": {"name": "tempest-keypair-1904351988", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBkOrR5zaVPyAWHg2+Tf8pBJxXf25rWlGrh49fF6ih4ZcPl6vdX1M9rdTy2NyQyMJnYNINP193QFWb3JT5J3H0bHc/B6ZnHuzqUaY6ea1ROr7OSBeKgO+lDLqoFhnTptQ=="}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:08:59.561809 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-2571200b-dabe-44c5-a647-2d7a6fac297a tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:59.562434 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-2571200b-dabe-44c5-a647-2d7a6fac297a tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:08:59.580160 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2571200b-dabe-44c5-a647-2d7a6fac297a tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:08:59.580893 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2571200b-dabe-44c5-a647-2d7a6fac297a tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:08:59.583421 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2571200b-dabe-44c5-a647-2d7a6fac297a tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:08:59.587560 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2571200b-dabe-44c5-a647-2d7a6fac297a tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:08:59.608888 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.quota [None req-c92c51a0-0fcf-4ea2-b2b1-e4f275dc2164 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Getting quotas for project 196700c560cd4d6e9461ec9571facf39. Resources: {'key_pairs'} {{(pid=117799) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:08:59.635180 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.quota [None req-c92c51a0-0fcf-4ea2-b2b1-e4f275dc2164 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Getting quotas for user 1421fb674ae04d6ea9ae342b73ce8115 and project 196700c560cd4d6e9461ec9571facf39. Resources: {'key_pairs'} {{(pid=117799) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:08:59.759763 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-c92c51a0-0fcf-4ea2-b2b1-e4f275dc2164 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.315211 May 26 15:08:59.763740 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 26/44] 10.222.0.45 () {60 vars in 1158 bytes} [Thu May 26 15:08:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:09:01.734875 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-53cec7ee-13fb-4de3-8068-352335c01718 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Action: 'create', calling method: .version_select at 0x7ffb5f323670>, body: {"keypair": {"name": "tempest-keypair-649054502", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdSj6eEEXxaYgrEOXf5w27JeiK4zzM6U+/eImMrfflEdoNkO24IfEskjiBVfP69fcwwx+9UMR4uFA8lOs+BmjvIxLbszEQDXZpdCEqHDchtzToOcgXwZ5KFUpenGiLWYA=="}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:01.819758 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.quota [None req-53cec7ee-13fb-4de3-8068-352335c01718 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Getting quotas for project b9de893c8bbd47b59e136fe46e791a52. Resources: {'key_pairs'} {{(pid=117799) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:09:01.833057 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.quota [None req-53cec7ee-13fb-4de3-8068-352335c01718 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Getting quotas for user 1748648695bb46a9b2c7912c48e95bbd and project b9de893c8bbd47b59e136fe46e791a52. Resources: {'key_pairs'} {{(pid=117799) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:09:01.851205 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2571200b-dabe-44c5-a647-2d7a6fac297a tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a1284bc044e51923c72a9f8f41d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39490fef872043d1bfef791dd0bbb5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:01.870404 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-2571200b-dabe-44c5-a647-2d7a6fac297a tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 200 len: 1314 microversion: 2.1 time: 2.311648 May 26 15:09:01.886440 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 19/45] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:08:59 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 1314 bytes in 2328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:01.921201 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-53cec7ee-13fb-4de3-8068-352335c01718 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.052090 May 26 15:09:01.924184 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 27/46] 10.222.0.45 () {62 vars in 1199 bytes} [Thu May 26 15:09:00 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1056 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 26 15:09:02.289782 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-bca31b08-5192-409a-bb5e-5b8b042eb2c7 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-334131508", "imageRef": "5b5a68b4-38e3-4f05-b97f-4339d6752e34", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:02.444279 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.network.neutron [None req-bca31b08-5192-409a-bb5e-5b8b042eb2c7 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] validate_networks() for [('639bd4c7-71e6-45c0-99da-922ed21622da', None, None, None, None, None)] {{(pid=117798) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:09:02.753437 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-54b3b4c7-64ce-474e-9321-0321aa9d5311 tempest-VolumesNegativeTest-1795414866 tempest-VolumesNegativeTest-1795414866-project] Action: 'create', calling method: .version_select at 0x7ffb5f3238b0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-465925311", "metadata": {"Type": "work"}}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:02.768259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-54b3b4c7-64ce-474e-9321-0321aa9d5311 tempest-VolumesNegativeTest-1795414866 tempest-VolumesNegativeTest-1795414866-project] Request method failure captured: May 26 15:09:02.768259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 15:09:02.768259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept: application/json May 26 15:09:02.768259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept-Encoding: identity May 26 15:09:02.768259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Connection: close May 26 15:09:02.768259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Length: 121 May 26 15:09:02.768259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Type: application/json May 26 15:09:02.768259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Host: 10.222.0.45 May 26 15:09:02.768259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Openstack-System-Scope: None May 26 15:09:02.768259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: User-Agent: python-urllib3/1.26.9 May 26 15:09:02.768259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Auth-Token: gAAAAABij5gNiGDtGJ33jh7PkQQqHKb50AWgL3bFU0nHQwtwFr0J2NdE1G8-oFWYF8rEurdzjGoiy9pxbz3T3c_AAFraFrpfJZdJLaGHLgZZIlnSaFuBUY1KIx4--kT7lJI9cJV0Ljtfve6JVq_ILcPXA2r16hYsDsAJm8Gclwnf4pp2IBAiHis May 26 15:09:02.768259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Id: None May 26 15:09:02.768259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Name: None May 26 15:09:02.768259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Identity-Status: Confirmed May 26 15:09:02.768259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Is-Admin-Project: True May 26 15:09:02.768259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Id: default May 26 15:09:02.768259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Name: Default May 26 15:09:02.768259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Id: f7650ecca019422fa96d994597396dc2 May 26 15:09:02.768259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Name: tempest-VolumesNegativeTest-1795414866 May 26 15:09:02.768259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Role: reader,member May 26 15:09:02.768259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Roles: reader,member May 26 15:09:02.769758 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f7650ecca019422fa96d994597396dc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f7650ecca019422fa96d994597396dc2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f7650ecca019422fa96d994597396dc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f7650ecca019422fa96d994597396dc2"}]}] May 26 15:09:02.769758 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant: tempest-VolumesNegativeTest-1795414866 May 26 15:09:02.769758 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Id: f7650ecca019422fa96d994597396dc2 May 26 15:09:02.769758 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Name: tempest-VolumesNegativeTest-1795414866 May 26 15:09:02.769758 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User: tempest-VolumesNegativeTest-1795414866-project May 26 15:09:02.769758 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Id: default May 26 15:09:02.769758 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Name: Default May 26 15:09:02.769758 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Id: 33b4b7c429734c0ba77551961ac2d472 May 26 15:09:02.769758 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Name: tempest-VolumesNegativeTest-1795414866-project May 26 15:09:02.769758 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: May 26 15:09:02.769758 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-465925311", "metadata": {"Type": "work"}}} May 26 15:09:02.769758 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: method: May 26 15:09:02.769758 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 15:09:02.770548 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-465925311', 'metadata': {'Type': 'work'}}}} May 26 15:09:02.770548 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:09:02.770548 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:09:02.770548 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 15:09:02.770548 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 15:09:02.770548 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 15:09:02.770548 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise error May 26 15:09:02.770548 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 26 15:09:02.770548 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:09:02.770548 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 26 15:09:02.770548 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 15:09:02.770548 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:09:02.770548 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 15:09:02.770548 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi '#$%' May 26 15:09:02.770548 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:09:02.770548 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:09:02.770548 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:09:02.770548 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:09:02.770548 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:09:02.770548 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:09:02.770548 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:09:02.770548 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:09:02.771962 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 15:09:02.771962 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 15:09:02.771962 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:09:02.771962 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:09:02.771962 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 15:09:02.771962 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 15:09:02.771962 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 15:09:02.771962 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 15:09:02.771962 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 15:09:02.771962 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 15:09:02.771962 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 15:09:02.771962 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:09:02.771962 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:09:02.771962 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:09:02.771962 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:09:02.771962 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:09:02.771962 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:09:02.771962 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 15:09:02.771962 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 15:09:02.773067 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 15:09:02.773067 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:09:02.774444 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-54b3b4c7-64ce-474e-9321-0321aa9d5311 tempest-VolumesNegativeTest-1795414866 tempest-VolumesNegativeTest-1795414866-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:09:02.775576 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-54b3b4c7-64ce-474e-9321-0321aa9d5311 tempest-VolumesNegativeTest-1795414866 tempest-VolumesNegativeTest-1795414866-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.849133 May 26 15:09:02.776532 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 28/47] 10.222.0.45 () {60 vars in 1155 bytes} [Thu May 26 15:09:01 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 851 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 15:09:02.982791 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-9905f45d-71cd-4f9e-89db-188b4410e7b8 req-e28041b7-97a8-4d48-9a78-dd6f93f46f24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8045b554-0891-4c2c-a842-76b806f8e817", "tag": "e06f6e86-12f3-4048-8f36-e642cd36ea4a"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:03.017978 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-9905f45d-71cd-4f9e-89db-188b4410e7b8 req-e28041b7-97a8-4d48-9a78-dd6f93f46f24 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:03.019512 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-9905f45d-71cd-4f9e-89db-188b4410e7b8 req-e28041b7-97a8-4d48-9a78-dd6f93f46f24 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:03.107602 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-9905f45d-71cd-4f9e-89db-188b4410e7b8 req-e28041b7-97a8-4d48-9a78-dd6f93f46f24 service nova] Creating event network-changed:e06f6e86-12f3-4048-8f36-e642cd36ea4a for instance 8045b554-0891-4c2c-a842-76b806f8e817 on hv-cinder-84301 May 26 15:09:03.108342 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-9905f45d-71cd-4f9e-89db-188b4410e7b8 req-e28041b7-97a8-4d48-9a78-dd6f93f46f24 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117799) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 26 15:09:03.111741 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1affb19b-8f49-449d-8916-8d11f8faa93c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:03.112314 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1affb19b-8f49-449d-8916-8d11f8faa93c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:03.114352 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1affb19b-8f49-449d-8916-8d11f8faa93c None None] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:03.123845 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1affb19b-8f49-449d-8916-8d11f8faa93c None None] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:03.135940 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.compute.rpcapi [None req-1affb19b-8f49-449d-8916-8d11f8faa93c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 26 15:09:03.148178 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1affb19b-8f49-449d-8916-8d11f8faa93c None None] Releasing lock "compute-rpcapi-router" {{(pid=117799) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 26 15:09:03.216283 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-1affb19b-8f49-449d-8916-8d11f8faa93c None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.438220 May 26 15:09:03.217313 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 29/48] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:09:03.225398 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-8a022015-7d95-456f-a90e-e08fd6be972f tempest-VolumesNegativeTest-1795414866 tempest-VolumesNegativeTest-1795414866-project] Action: 'create', calling method: .version_select at 0x7ffb5f323790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-715720599", "metadata": {"Type": "work"}}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:03.228072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-8a022015-7d95-456f-a90e-e08fd6be972f tempest-VolumesNegativeTest-1795414866 tempest-VolumesNegativeTest-1795414866-project] Request method failure captured: May 26 15:09:03.228072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 15:09:03.228072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept: application/json May 26 15:09:03.228072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept-Encoding: identity May 26 15:09:03.228072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Connection: close May 26 15:09:03.228072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Length: 119 May 26 15:09:03.228072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Type: application/json May 26 15:09:03.228072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Host: 10.222.0.45 May 26 15:09:03.228072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Openstack-System-Scope: None May 26 15:09:03.228072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: User-Agent: python-urllib3/1.26.9 May 26 15:09:03.228072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Auth-Token: gAAAAABij5gNiGDtGJ33jh7PkQQqHKb50AWgL3bFU0nHQwtwFr0J2NdE1G8-oFWYF8rEurdzjGoiy9pxbz3T3c_AAFraFrpfJZdJLaGHLgZZIlnSaFuBUY1KIx4--kT7lJI9cJV0Ljtfve6JVq_ILcPXA2r16hYsDsAJm8Gclwnf4pp2IBAiHis May 26 15:09:03.228072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Id: None May 26 15:09:03.228072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Name: None May 26 15:09:03.228072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Identity-Status: Confirmed May 26 15:09:03.228072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Is-Admin-Project: True May 26 15:09:03.228072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Id: default May 26 15:09:03.228072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Name: Default May 26 15:09:03.228072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Id: f7650ecca019422fa96d994597396dc2 May 26 15:09:03.228072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Name: tempest-VolumesNegativeTest-1795414866 May 26 15:09:03.228072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Role: reader,member May 26 15:09:03.228072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Roles: reader,member May 26 15:09:03.229190 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f7650ecca019422fa96d994597396dc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f7650ecca019422fa96d994597396dc2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f7650ecca019422fa96d994597396dc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f7650ecca019422fa96d994597396dc2"}]}] May 26 15:09:03.229190 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant: tempest-VolumesNegativeTest-1795414866 May 26 15:09:03.229190 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Id: f7650ecca019422fa96d994597396dc2 May 26 15:09:03.229190 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Name: tempest-VolumesNegativeTest-1795414866 May 26 15:09:03.229190 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User: tempest-VolumesNegativeTest-1795414866-project May 26 15:09:03.229190 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Id: default May 26 15:09:03.229190 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Name: Default May 26 15:09:03.229190 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Id: 33b4b7c429734c0ba77551961ac2d472 May 26 15:09:03.229190 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Name: tempest-VolumesNegativeTest-1795414866-project May 26 15:09:03.229190 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: May 26 15:09:03.229190 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-715720599", "metadata": {"Type": "work"}}} May 26 15:09:03.229190 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: method: May 26 15:09:03.229190 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 15:09:03.229842 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-715720599', 'metadata': {'Type': 'work'}}}} May 26 15:09:03.229842 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:09:03.229842 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:09:03.229842 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 15:09:03.229842 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 15:09:03.229842 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 15:09:03.229842 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise error May 26 15:09:03.229842 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 26 15:09:03.229842 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:09:03.229842 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 26 15:09:03.229842 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 15:09:03.229842 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:09:03.229842 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 15:09:03.229842 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi '0' May 26 15:09:03.229842 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:09:03.229842 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:09:03.229842 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:09:03.229842 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:09:03.229842 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:09:03.229842 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:09:03.229842 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:09:03.229842 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:09:03.230877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 15:09:03.230877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 15:09:03.230877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:09:03.230877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:09:03.230877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 15:09:03.230877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 15:09:03.230877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 15:09:03.230877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 15:09:03.230877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 15:09:03.230877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 15:09:03.230877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 15:09:03.230877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:09:03.230877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:09:03.230877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:09:03.230877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:09:03.230877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:09:03.230877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:09:03.230877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 15:09:03.230877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 15:09:03.231977 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 15:09:03.231977 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:09:03.231977 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-8a022015-7d95-456f-a90e-e08fd6be972f tempest-VolumesNegativeTest-1795414866 tempest-VolumesNegativeTest-1795414866-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:09:03.239614 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-8a022015-7d95-456f-a90e-e08fd6be972f tempest-VolumesNegativeTest-1795414866 tempest-VolumesNegativeTest-1795414866-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010898 May 26 15:09:03.240468 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 30/49] 10.222.0.45 () {60 vars in 1155 bytes} [Thu May 26 15:09:03 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 15:09:03.256773 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-6c506805-51ea-41a4-b9b6-d4d3fd0d2217 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:03.257542 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-6c506805-51ea-41a4-b9b6-d4d3fd0d2217 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:03.285557 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6c506805-51ea-41a4-b9b6-d4d3fd0d2217 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:03.287543 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6c506805-51ea-41a4-b9b6-d4d3fd0d2217 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:03.301071 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6c506805-51ea-41a4-b9b6-d4d3fd0d2217 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:03.301606 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6c506805-51ea-41a4-b9b6-d4d3fd0d2217 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:05.247252 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-6c506805-51ea-41a4-b9b6-d4d3fd0d2217 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a1284bc044e51923c72a9f8f41d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39490fef872043d1bfef791dd0bbb5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:05.256508 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-6c506805-51ea-41a4-b9b6-d4d3fd0d2217 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 200 len: 1314 microversion: 2.1 time: 2.014364 May 26 15:09:05.259495 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 31/50] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:03 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 1314 bytes in 2018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:05.275386 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-a8ba4638-7336-4642-b4ad-12a35a53f93c tempest-VolumesNegativeTest-1795414866 tempest-VolumesNegativeTest-1795414866-project] Action: 'create', calling method: .version_select at 0x7ffb5f3239d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1125382593", "metadata": {"Type": "work"}}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:05.278259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-a8ba4638-7336-4642-b4ad-12a35a53f93c tempest-VolumesNegativeTest-1795414866 tempest-VolumesNegativeTest-1795414866-project] Request method failure captured: May 26 15:09:05.278259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 15:09:05.278259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept: application/json May 26 15:09:05.278259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept-Encoding: identity May 26 15:09:05.278259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Connection: close May 26 15:09:05.278259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Length: 119 May 26 15:09:05.278259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Type: application/json May 26 15:09:05.278259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Host: 10.222.0.45 May 26 15:09:05.278259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Openstack-System-Scope: None May 26 15:09:05.278259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: User-Agent: python-urllib3/1.26.9 May 26 15:09:05.278259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Auth-Token: gAAAAABij5gNiGDtGJ33jh7PkQQqHKb50AWgL3bFU0nHQwtwFr0J2NdE1G8-oFWYF8rEurdzjGoiy9pxbz3T3c_AAFraFrpfJZdJLaGHLgZZIlnSaFuBUY1KIx4--kT7lJI9cJV0Ljtfve6JVq_ILcPXA2r16hYsDsAJm8Gclwnf4pp2IBAiHis May 26 15:09:05.278259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Id: None May 26 15:09:05.278259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Name: None May 26 15:09:05.278259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Identity-Status: Confirmed May 26 15:09:05.278259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Is-Admin-Project: True May 26 15:09:05.278259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Id: default May 26 15:09:05.278259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Name: Default May 26 15:09:05.278259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Id: f7650ecca019422fa96d994597396dc2 May 26 15:09:05.278259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Name: tempest-VolumesNegativeTest-1795414866 May 26 15:09:05.278259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Role: reader,member May 26 15:09:05.278259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Roles: reader,member May 26 15:09:05.280014 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f7650ecca019422fa96d994597396dc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f7650ecca019422fa96d994597396dc2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f7650ecca019422fa96d994597396dc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f7650ecca019422fa96d994597396dc2"}]}] May 26 15:09:05.280014 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant: tempest-VolumesNegativeTest-1795414866 May 26 15:09:05.280014 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Id: f7650ecca019422fa96d994597396dc2 May 26 15:09:05.280014 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Name: tempest-VolumesNegativeTest-1795414866 May 26 15:09:05.280014 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User: tempest-VolumesNegativeTest-1795414866-project May 26 15:09:05.280014 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Id: default May 26 15:09:05.280014 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Name: Default May 26 15:09:05.280014 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Id: 33b4b7c429734c0ba77551961ac2d472 May 26 15:09:05.280014 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Name: tempest-VolumesNegativeTest-1795414866-project May 26 15:09:05.280014 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: May 26 15:09:05.280014 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1125382593", "metadata": {"Type": "work"}}} May 26 15:09:05.280014 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: method: May 26 15:09:05.280014 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 15:09:05.288742 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1125382593', 'metadata': {'Type': 'work'}}}} May 26 15:09:05.288742 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:09:05.288742 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:09:05.288742 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 15:09:05.288742 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 15:09:05.288742 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 15:09:05.288742 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise error May 26 15:09:05.288742 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 26 15:09:05.288742 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:09:05.288742 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 26 15:09:05.288742 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 15:09:05.288742 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:09:05.288742 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 15:09:05.288742 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi '' May 26 15:09:05.288742 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:09:05.288742 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:09:05.288742 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:09:05.288742 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:09:05.288742 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:09:05.288742 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:09:05.288742 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:09:05.288742 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:09:05.290239 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 15:09:05.290239 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 15:09:05.290239 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:09:05.290239 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:09:05.290239 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 15:09:05.290239 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 15:09:05.290239 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 15:09:05.290239 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 15:09:05.290239 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 15:09:05.290239 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 15:09:05.290239 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 15:09:05.290239 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:09:05.290239 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:09:05.290239 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:09:05.290239 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:09:05.290239 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:09:05.290239 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:09:05.290239 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 15:09:05.290239 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 15:09:05.292801 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 15:09:05.292801 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:09:05.292801 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-a8ba4638-7336-4642-b4ad-12a35a53f93c tempest-VolumesNegativeTest-1795414866 tempest-VolumesNegativeTest-1795414866-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:09:05.292801 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-a8ba4638-7336-4642-b4ad-12a35a53f93c tempest-VolumesNegativeTest-1795414866 tempest-VolumesNegativeTest-1795414866-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.019137 May 26 15:09:05.292801 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 32/51] 10.222.0.45 () {60 vars in 1155 bytes} [Thu May 26 15:09:05 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 15:09:05.292801 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-b7ae276b-930c-47f9-8de1-069f311fd6df tempest-VolumesNegativeTest-1795414866 tempest-VolumesNegativeTest-1795414866-project] Calling method '.version_select at 0x7ffb5f2eeb80>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:05.415590 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.wsgi [None req-b7ae276b-930c-47f9-8de1-069f311fd6df tempest-VolumesNegativeTest-1795414866 tempest-VolumesNegativeTest-1795414866-project] HTTP exception thrown: Volume tempest-invalid-1529431015 could not be found. May 26 15:09:05.418072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-b7ae276b-930c-47f9-8de1-069f311fd6df tempest-VolumesNegativeTest-1795414866 tempest-VolumesNegativeTest-1795414866-project] Request method failure captured: May 26 15:09:05.418072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1529431015 HTTP/1.1 May 26 15:09:05.418072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept: application/json May 26 15:09:05.418072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept-Encoding: identity May 26 15:09:05.418072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Connection: close May 26 15:09:05.418072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Length: 0 May 26 15:09:05.418072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Type: application/json May 26 15:09:05.418072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Host: 10.222.0.45 May 26 15:09:05.418072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Openstack-System-Scope: None May 26 15:09:05.418072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: User-Agent: python-urllib3/1.26.9 May 26 15:09:05.418072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Auth-Token: gAAAAABij5gNiGDtGJ33jh7PkQQqHKb50AWgL3bFU0nHQwtwFr0J2NdE1G8-oFWYF8rEurdzjGoiy9pxbz3T3c_AAFraFrpfJZdJLaGHLgZZIlnSaFuBUY1KIx4--kT7lJI9cJV0Ljtfve6JVq_ILcPXA2r16hYsDsAJm8Gclwnf4pp2IBAiHis May 26 15:09:05.418072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Id: None May 26 15:09:05.418072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Name: None May 26 15:09:05.418072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Identity-Status: Confirmed May 26 15:09:05.418072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Is-Admin-Project: True May 26 15:09:05.418072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Id: default May 26 15:09:05.418072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Name: Default May 26 15:09:05.418072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Id: f7650ecca019422fa96d994597396dc2 May 26 15:09:05.418072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Name: tempest-VolumesNegativeTest-1795414866 May 26 15:09:05.418072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Role: reader,member May 26 15:09:05.418072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Roles: reader,member May 26 15:09:05.419524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f7650ecca019422fa96d994597396dc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f7650ecca019422fa96d994597396dc2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f7650ecca019422fa96d994597396dc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f7650ecca019422fa96d994597396dc2"}]}] May 26 15:09:05.419524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant: tempest-VolumesNegativeTest-1795414866 May 26 15:09:05.419524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Id: f7650ecca019422fa96d994597396dc2 May 26 15:09:05.419524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Name: tempest-VolumesNegativeTest-1795414866 May 26 15:09:05.419524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User: tempest-VolumesNegativeTest-1795414866-project May 26 15:09:05.419524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Id: default May 26 15:09:05.419524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Name: Default May 26 15:09:05.419524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Id: 33b4b7c429734c0ba77551961ac2d472 May 26 15:09:05.419524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Name: tempest-VolumesNegativeTest-1795414866-project May 26 15:09:05.419524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: method: May 26 15:09:05.419524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: exception: Volume tempest-invalid-1529431015 could not be found. May 26 15:09:05.419524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: action_args: {'id': 'tempest-invalid-1529431015'} May 26 15:09:05.419524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:09:05.420985 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:09:05.420985 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 15:09:05.420985 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 15:09:05.420985 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 15:09:05.420985 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 15:09:05.420985 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 15:09:05.420985 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 15:09:05.420985 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 15:09:05.420985 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 15:09:05.420985 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 15:09:05.420985 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 15:09:05.420985 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 15:09:05.420985 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 15:09:05.420985 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 15:09:05.420985 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 15:09:05.420985 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1529431015 could not be found. (HTTP 404) (Request-ID: req-e4addb7a-a422-4fce-998b-53701a86eb63) May 26 15:09:05.420985 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:09:05.420985 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:09:05.420985 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:09:05.423788 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:09:05.423788 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 15:09:05.423788 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 15:09:05.423788 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 15:09:05.423788 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 15:09:05.423788 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 15:09:05.423788 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 15:09:05.423788 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 15:09:05.423788 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 15:09:05.423788 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 15:09:05.423788 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 15:09:05.423788 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 15:09:05.423788 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 15:09:05.423788 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 15:09:05.423788 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 15:09:05.423788 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 15:09:05.423788 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 15:09:05.423788 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 15:09:05.423788 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 15:09:05.425741 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 15:09:05.425741 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 15:09:05.425741 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 15:09:05.425741 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 15:09:05.425741 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1529431015 could not be found. May 26 15:09:05.425741 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:09:05.425741 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:09:05.425741 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:09:05.425741 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:09:05.425741 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:09:05.425741 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:09:05.425741 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:09:05.425741 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:09:05.425741 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 15:09:05.425741 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 15:09:05.425741 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:09:05.425741 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:09:05.425741 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 15:09:05.425741 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:09:05.425741 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1529431015 could not be found. May 26 15:09:05.427956 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:09:05.427956 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:09:05.427956 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:09:05.427956 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:09:05.427956 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:09:05.427956 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:09:05.427956 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:09:05.427956 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:09:05.427956 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1529431015 could not be found. May 26 15:09:05.427956 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:09:05.430541 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-b7ae276b-930c-47f9-8de1-069f311fd6df tempest-VolumesNegativeTest-1795414866 tempest-VolumesNegativeTest-1795414866-project] Returning 404 to user: Volume tempest-invalid-1529431015 could not be found. {{(pid=117799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:09:05.432343 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-b7ae276b-930c-47f9-8de1-069f311fd6df tempest-VolumesNegativeTest-1795414866 tempest-VolumesNegativeTest-1795414866-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1529431015" status: 404 len: 99 microversion: 2.1 time: 0.143928 May 26 15:09:05.433967 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 33/52] 10.222.0.45 () {58 vars in 1217 bytes} [Thu May 26 15:09:05 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1529431015 => generated 99 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 26 15:09:05.456487 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-b5bceebb-e6d4-4419-a547-69988fb5eca9 tempest-VolumesNegativeTest-1795414866 tempest-VolumesNegativeTest-1795414866-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.015349 May 26 15:09:05.463424 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 34/53] 10.222.0.45 () {58 vars in 1139 bytes} [Thu May 26 15:09:05 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 26 15:09:05.473815 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-cf4578f9-73f8-4128-9e39-743b5d7b0c98 tempest-VolumesNegativeTest-1795414866 tempest-VolumesNegativeTest-1795414866-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004915 May 26 15:09:05.474353 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 35/54] 10.222.0.45 () {58 vars in 1136 bytes} [Thu May 26 15:09:05 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 26 15:09:05.490668 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-feddb865-c052-46ad-a8cc-6c283799bf19 tempest-VolumesNegativeTest-1795414866 tempest-VolumesNegativeTest-1795414866-project] Calling method '.version_select at 0x7ffb5f323d30>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:05.555997 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.wsgi [None req-feddb865-c052-46ad-a8cc-6c283799bf19 tempest-VolumesNegativeTest-1795414866 tempest-VolumesNegativeTest-1795414866-project] HTTP exception thrown: Volume 8c9556d0-9d53-4bfa-a09d-ab1fffbbc691 could not be found. May 26 15:09:05.558898 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-feddb865-c052-46ad-a8cc-6c283799bf19 tempest-VolumesNegativeTest-1795414866 tempest-VolumesNegativeTest-1795414866-project] Request method failure captured: May 26 15:09:05.558898 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: request: DELETE /compute/v2.1/os-volumes/8c9556d0-9d53-4bfa-a09d-ab1fffbbc691 HTTP/1.1 May 26 15:09:05.558898 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept: application/json May 26 15:09:05.558898 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept-Encoding: identity May 26 15:09:05.558898 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Connection: close May 26 15:09:05.558898 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Length: 0 May 26 15:09:05.558898 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Type: application/json May 26 15:09:05.558898 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Host: 10.222.0.45 May 26 15:09:05.558898 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Openstack-System-Scope: None May 26 15:09:05.558898 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: User-Agent: python-urllib3/1.26.9 May 26 15:09:05.558898 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Auth-Token: gAAAAABij5gNiGDtGJ33jh7PkQQqHKb50AWgL3bFU0nHQwtwFr0J2NdE1G8-oFWYF8rEurdzjGoiy9pxbz3T3c_AAFraFrpfJZdJLaGHLgZZIlnSaFuBUY1KIx4--kT7lJI9cJV0Ljtfve6JVq_ILcPXA2r16hYsDsAJm8Gclwnf4pp2IBAiHis May 26 15:09:05.558898 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Id: None May 26 15:09:05.558898 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Name: None May 26 15:09:05.558898 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Identity-Status: Confirmed May 26 15:09:05.558898 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Is-Admin-Project: True May 26 15:09:05.558898 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Id: default May 26 15:09:05.558898 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Name: Default May 26 15:09:05.558898 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Id: f7650ecca019422fa96d994597396dc2 May 26 15:09:05.558898 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Name: tempest-VolumesNegativeTest-1795414866 May 26 15:09:05.558898 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Role: reader,member May 26 15:09:05.558898 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Roles: reader,member May 26 15:09:05.560199 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f7650ecca019422fa96d994597396dc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f7650ecca019422fa96d994597396dc2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f7650ecca019422fa96d994597396dc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f7650ecca019422fa96d994597396dc2"}]}] May 26 15:09:05.560199 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant: tempest-VolumesNegativeTest-1795414866 May 26 15:09:05.560199 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Id: f7650ecca019422fa96d994597396dc2 May 26 15:09:05.560199 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Name: tempest-VolumesNegativeTest-1795414866 May 26 15:09:05.560199 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User: tempest-VolumesNegativeTest-1795414866-project May 26 15:09:05.560199 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Id: default May 26 15:09:05.560199 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Name: Default May 26 15:09:05.560199 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Id: 33b4b7c429734c0ba77551961ac2d472 May 26 15:09:05.560199 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Name: tempest-VolumesNegativeTest-1795414866-project May 26 15:09:05.560199 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: method: May 26 15:09:05.560199 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: exception: Volume 8c9556d0-9d53-4bfa-a09d-ab1fffbbc691 could not be found. May 26 15:09:05.560199 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: action_args: {'id': '8c9556d0-9d53-4bfa-a09d-ab1fffbbc691'} May 26 15:09:05.560199 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:09:05.561060 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:09:05.561060 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 15:09:05.561060 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 15:09:05.561060 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 15:09:05.561060 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 15:09:05.561060 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 15:09:05.561060 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 15:09:05.561060 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 15:09:05.561060 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 15:09:05.561060 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 15:09:05.561060 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 15:09:05.561060 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 15:09:05.561060 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 15:09:05.561060 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 15:09:05.561060 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 15:09:05.561060 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8c9556d0-9d53-4bfa-a09d-ab1fffbbc691 could not be found. (HTTP 404) (Request-ID: req-3d6d983c-207a-4504-b21c-6929f1867a95) May 26 15:09:05.561060 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:09:05.561060 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:09:05.561060 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:09:05.562171 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:09:05.562171 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 15:09:05.562171 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 15:09:05.562171 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 15:09:05.562171 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 15:09:05.562171 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 15:09:05.562171 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 15:09:05.562171 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 15:09:05.562171 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 15:09:05.562171 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 15:09:05.562171 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 15:09:05.562171 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 15:09:05.562171 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 15:09:05.562171 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 15:09:05.562171 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 15:09:05.562171 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 15:09:05.562171 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 15:09:05.562171 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 15:09:05.562171 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 15:09:05.563877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 15:09:05.563877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 15:09:05.563877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 15:09:05.563877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 15:09:05.563877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8c9556d0-9d53-4bfa-a09d-ab1fffbbc691 could not be found. May 26 15:09:05.563877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:09:05.563877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:09:05.563877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:09:05.563877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:09:05.563877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:09:05.563877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:09:05.563877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:09:05.563877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:09:05.563877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 15:09:05.563877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 15:09:05.563877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:09:05.563877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:09:05.563877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 15:09:05.563877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:09:05.565139 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8c9556d0-9d53-4bfa-a09d-ab1fffbbc691 could not be found. May 26 15:09:05.565139 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:09:05.565139 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:09:05.565139 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:09:05.565139 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:09:05.565139 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:09:05.565139 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:09:05.565139 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:09:05.565139 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:09:05.565139 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8c9556d0-9d53-4bfa-a09d-ab1fffbbc691 could not be found. May 26 15:09:05.565139 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:09:05.566610 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-feddb865-c052-46ad-a8cc-6c283799bf19 tempest-VolumesNegativeTest-1795414866 tempest-VolumesNegativeTest-1795414866-project] Returning 404 to user: Volume 8c9556d0-9d53-4bfa-a09d-ab1fffbbc691 could not be found. {{(pid=117799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:09:05.567711 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-feddb865-c052-46ad-a8cc-6c283799bf19 tempest-VolumesNegativeTest-1795414866 tempest-VolumesNegativeTest-1795414866-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/8c9556d0-9d53-4bfa-a09d-ab1fffbbc691" status: 404 len: 109 microversion: 2.1 time: 0.081125 May 26 15:09:05.568383 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 36/55] 10.222.0.45 () {58 vars in 1247 bytes} [Thu May 26 15:09:05 2022] DELETE /compute/v2.1/os-volumes/8c9556d0-9d53-4bfa-a09d-ab1fffbbc691 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 15:09:05.590013 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-92dd178a-341d-4548-bf82-52c5a24603cf tempest-VolumesNegativeTest-1795414866 tempest-VolumesNegativeTest-1795414866-project] Calling method '.version_select at 0x7ffb5f2ee5e0>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:05.648916 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.wsgi [None req-92dd178a-341d-4548-bf82-52c5a24603cf tempest-VolumesNegativeTest-1795414866 tempest-VolumesNegativeTest-1795414866-project] HTTP exception thrown: Volume 89edcbeb-9b58-42fc-a6e1-5fe7b6dcef5a could not be found. May 26 15:09:05.651386 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-92dd178a-341d-4548-bf82-52c5a24603cf tempest-VolumesNegativeTest-1795414866 tempest-VolumesNegativeTest-1795414866-project] Request method failure captured: May 26 15:09:05.651386 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: request: GET /compute/v2.1/os-volumes/89edcbeb-9b58-42fc-a6e1-5fe7b6dcef5a HTTP/1.1 May 26 15:09:05.651386 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept: application/json May 26 15:09:05.651386 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept-Encoding: identity May 26 15:09:05.651386 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Connection: close May 26 15:09:05.651386 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Length: 0 May 26 15:09:05.651386 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Type: application/json May 26 15:09:05.651386 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Host: 10.222.0.45 May 26 15:09:05.651386 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Openstack-System-Scope: None May 26 15:09:05.651386 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: User-Agent: python-urllib3/1.26.9 May 26 15:09:05.651386 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Auth-Token: gAAAAABij5gNiGDtGJ33jh7PkQQqHKb50AWgL3bFU0nHQwtwFr0J2NdE1G8-oFWYF8rEurdzjGoiy9pxbz3T3c_AAFraFrpfJZdJLaGHLgZZIlnSaFuBUY1KIx4--kT7lJI9cJV0Ljtfve6JVq_ILcPXA2r16hYsDsAJm8Gclwnf4pp2IBAiHis May 26 15:09:05.651386 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Id: None May 26 15:09:05.651386 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Name: None May 26 15:09:05.651386 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Identity-Status: Confirmed May 26 15:09:05.651386 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Is-Admin-Project: True May 26 15:09:05.651386 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Id: default May 26 15:09:05.651386 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Name: Default May 26 15:09:05.651386 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Id: f7650ecca019422fa96d994597396dc2 May 26 15:09:05.651386 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Name: tempest-VolumesNegativeTest-1795414866 May 26 15:09:05.651386 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Role: reader,member May 26 15:09:05.651386 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Roles: reader,member May 26 15:09:05.652609 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f7650ecca019422fa96d994597396dc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f7650ecca019422fa96d994597396dc2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f7650ecca019422fa96d994597396dc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f7650ecca019422fa96d994597396dc2"}]}] May 26 15:09:05.652609 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant: tempest-VolumesNegativeTest-1795414866 May 26 15:09:05.652609 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Id: f7650ecca019422fa96d994597396dc2 May 26 15:09:05.652609 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Name: tempest-VolumesNegativeTest-1795414866 May 26 15:09:05.652609 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User: tempest-VolumesNegativeTest-1795414866-project May 26 15:09:05.652609 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Id: default May 26 15:09:05.652609 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Name: Default May 26 15:09:05.652609 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Id: 33b4b7c429734c0ba77551961ac2d472 May 26 15:09:05.652609 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Name: tempest-VolumesNegativeTest-1795414866-project May 26 15:09:05.652609 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: method: May 26 15:09:05.652609 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: exception: Volume 89edcbeb-9b58-42fc-a6e1-5fe7b6dcef5a could not be found. May 26 15:09:05.652609 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: action_args: {'id': '89edcbeb-9b58-42fc-a6e1-5fe7b6dcef5a'} May 26 15:09:05.652609 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:09:05.653367 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:09:05.653367 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 15:09:05.653367 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 15:09:05.653367 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 15:09:05.653367 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 15:09:05.653367 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 15:09:05.653367 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 15:09:05.653367 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 15:09:05.653367 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 15:09:05.653367 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 15:09:05.653367 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 15:09:05.653367 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 15:09:05.653367 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 15:09:05.653367 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 15:09:05.653367 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 15:09:05.653367 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 89edcbeb-9b58-42fc-a6e1-5fe7b6dcef5a could not be found. (HTTP 404) (Request-ID: req-c087243a-751f-4253-a54c-210756dc94b0) May 26 15:09:05.653367 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:09:05.653367 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:09:05.653367 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:09:05.654441 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:09:05.654441 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 15:09:05.654441 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 15:09:05.654441 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 15:09:05.654441 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 15:09:05.654441 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 15:09:05.654441 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 15:09:05.654441 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 15:09:05.654441 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 15:09:05.654441 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 15:09:05.654441 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 15:09:05.654441 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 15:09:05.654441 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 15:09:05.654441 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 15:09:05.654441 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 15:09:05.654441 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 15:09:05.654441 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 15:09:05.654441 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 15:09:05.654441 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 15:09:05.655524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 15:09:05.655524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 15:09:05.655524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 15:09:05.655524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 15:09:05.655524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 89edcbeb-9b58-42fc-a6e1-5fe7b6dcef5a could not be found. May 26 15:09:05.655524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:09:05.655524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:09:05.655524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:09:05.655524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:09:05.655524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:09:05.655524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:09:05.655524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:09:05.655524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:09:05.655524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 15:09:05.655524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 15:09:05.655524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:09:05.655524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:09:05.655524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 15:09:05.655524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:09:05.656656 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 89edcbeb-9b58-42fc-a6e1-5fe7b6dcef5a could not be found. May 26 15:09:05.656656 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:09:05.656656 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:09:05.656656 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:09:05.656656 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:09:05.656656 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:09:05.656656 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:09:05.656656 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:09:05.656656 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:09:05.656656 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 89edcbeb-9b58-42fc-a6e1-5fe7b6dcef5a could not be found. May 26 15:09:05.656656 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:09:05.659121 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-92dd178a-341d-4548-bf82-52c5a24603cf tempest-VolumesNegativeTest-1795414866 tempest-VolumesNegativeTest-1795414866-project] Returning 404 to user: Volume 89edcbeb-9b58-42fc-a6e1-5fe7b6dcef5a could not be found. {{(pid=117799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:09:05.659121 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-92dd178a-341d-4548-bf82-52c5a24603cf tempest-VolumesNegativeTest-1795414866 tempest-VolumesNegativeTest-1795414866-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/89edcbeb-9b58-42fc-a6e1-5fe7b6dcef5a" status: 404 len: 109 microversion: 2.1 time: 0.082605 May 26 15:09:05.660154 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 37/56] 10.222.0.45 () {58 vars in 1244 bytes} [Thu May 26 15:09:05 2022] GET /compute/v2.1/os-volumes/89edcbeb-9b58-42fc-a6e1-5fe7b6dcef5a => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 15:09:05.791651 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-bca31b08-5192-409a-bb5e-5b8b042eb2c7 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Flavor limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:09:05.792171 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-bca31b08-5192-409a-bb5e-5b8b042eb2c7 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Image limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:09:05.792677 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-bca31b08-5192-409a-bb5e-5b8b042eb2c7 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Flavor pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:09:05.793095 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-bca31b08-5192-409a-bb5e-5b8b042eb2c7 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Image pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:09:05.793576 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-bca31b08-5192-409a-bb5e-5b8b042eb2c7 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:09:05.834315 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bca31b08-5192-409a-bb5e-5b8b042eb2c7 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:05.834969 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bca31b08-5192-409a-bb5e-5b8b042eb2c7 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:05.845315 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bca31b08-5192-409a-bb5e-5b8b042eb2c7 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:05.855652 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bca31b08-5192-409a-bb5e-5b8b042eb2c7 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:05.937488 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-bca31b08-5192-409a-bb5e-5b8b042eb2c7 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Getting quotas for project bf95995343d547f78ae88a425f584ac7. Resources: {'cores', 'ram', 'instances'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:09:05.963642 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-bca31b08-5192-409a-bb5e-5b8b042eb2c7 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Getting quotas for user e29a5217495c41dda9564db96f6e36d1 and project bf95995343d547f78ae88a425f584ac7. Resources: {'cores', 'ram', 'instances'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:09:06.006154 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-bca31b08-5192-409a-bb5e-5b8b042eb2c7 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Going to run 1 instances... {{(pid=117798) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:09:06.015262 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-bca31b08-5192-409a-bb5e-5b8b042eb2c7 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: ab471a8e-c724-4c71-b9ce-b253771d23a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5b5a68b4-38e3-4f05-b97f-4339d6752e34',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:09:06.200999 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-bca31b08-5192-409a-bb5e-5b8b042eb2c7 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.314269 May 26 15:09:06.212970 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 20/57] 10.222.0.45 () {60 vars in 1146 bytes} [Thu May 26 15:09:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 4327 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 15:09:06.214515 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-ddc37edc-bac7-40f4-8a99-018ae950bc32 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:06.217840 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-ddc37edc-bac7-40f4-8a99-018ae950bc32 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: ab471a8e-c724-4c71-b9ce-b253771d23a1] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:06.275369 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f37d319b-5c0b-4662-bdbc-dbc510704778 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:06.276036 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f37d319b-5c0b-4662-bdbc-dbc510704778 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:06.290350 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f37d319b-5c0b-4662-bdbc-dbc510704778 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:06.292260 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f37d319b-5c0b-4662-bdbc-dbc510704778 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:06.293694 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f37d319b-5c0b-4662-bdbc-dbc510704778 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:06.294442 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f37d319b-5c0b-4662-bdbc-dbc510704778 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:06.442844 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-ddc37edc-bac7-40f4-8a99-018ae950bc32 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:06.454281 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-ddc37edc-bac7-40f4-8a99-018ae950bc32 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1" status: 200 len: 1221 microversion: 2.1 time: 0.245300 May 26 15:09:06.459975 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 38/58] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:06 2022] GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1 => generated 1221 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:07.198490 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-54c63306-75ea-49d7-adcb-1a89f64f00c8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-978332775", "imageRef": "5b5a68b4-38e3-4f05-b97f-4339d6752e34", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:07.261737 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f37d319b-5c0b-4662-bdbc-dbc510704778 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a1284bc044e51923c72a9f8f41d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39490fef872043d1bfef791dd0bbb5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:07.283873 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f37d319b-5c0b-4662-bdbc-dbc510704778 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 200 len: 1314 microversion: 2.1 time: 1.012114 May 26 15:09:07.285721 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 21/59] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:06 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 1314 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:07.433545 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.network.neutron [None req-54c63306-75ea-49d7-adcb-1a89f64f00c8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] validate_networks() for [('639bd4c7-71e6-45c0-99da-922ed21622da', None, None, None, None, None)] {{(pid=117799) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:09:08.313749 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d4c7bb54-8049-45f8-934a-b68d2bec6a9c tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:08.315554 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-d4c7bb54-8049-45f8-934a-b68d2bec6a9c tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:08.384393 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d4c7bb54-8049-45f8-934a-b68d2bec6a9c tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:08.386502 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d4c7bb54-8049-45f8-934a-b68d2bec6a9c tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:08.389124 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d4c7bb54-8049-45f8-934a-b68d2bec6a9c tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:08.392306 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d4c7bb54-8049-45f8-934a-b68d2bec6a9c tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:09.365449 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d4c7bb54-8049-45f8-934a-b68d2bec6a9c tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a1284bc044e51923c72a9f8f41d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39490fef872043d1bfef791dd0bbb5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:09.374535 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-d4c7bb54-8049-45f8-934a-b68d2bec6a9c tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 200 len: 1314 microversion: 2.1 time: 1.075996 May 26 15:09:09.377164 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 22/60] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:08 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 1314 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:09.393735 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-85735065-b952-41cf-af58-517ecf803f83 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-713490611", "imageRef": "5b5a68b4-38e3-4f05-b97f-4339d6752e34", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "01254fed-0134-4032-8891-3e7c400b7875"}], "security_groups": [{"name": "tempest-securitygroup--908402323"}], "key_name": "tempest-keypair-1782266556", "user_data": "}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:10.117111 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.network.neutron [None req-85735065-b952-41cf-af58-517ecf803f83 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] validate_networks() for [('01254fed-0134-4032-8891-3e7c400b7875', None, None, None, None, None)] {{(pid=117798) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:09:10.836302 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=6 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:10.955795 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-54c63306-75ea-49d7-adcb-1a89f64f00c8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Flavor limits 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:09:10.956296 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-54c63306-75ea-49d7-adcb-1a89f64f00c8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Image limits 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:09:10.956700 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-54c63306-75ea-49d7-adcb-1a89f64f00c8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Flavor pref 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:09:10.957109 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-54c63306-75ea-49d7-adcb-1a89f64f00c8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Image pref 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:09:10.957518 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-54c63306-75ea-49d7-adcb-1a89f64f00c8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:09:10.959849 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:10.984167 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-54c63306-75ea-49d7-adcb-1a89f64f00c8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:10.985418 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-54c63306-75ea-49d7-adcb-1a89f64f00c8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:10.986561 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-54c63306-75ea-49d7-adcb-1a89f64f00c8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:10.987213 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-54c63306-75ea-49d7-adcb-1a89f64f00c8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:11.044925 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.quota [None req-54c63306-75ea-49d7-adcb-1a89f64f00c8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Getting quotas for project bf95995343d547f78ae88a425f584ac7. Resources: {'cores', 'ram', 'instances'} {{(pid=117799) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:09:11.054814 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.quota [None req-54c63306-75ea-49d7-adcb-1a89f64f00c8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Getting quotas for user e29a5217495c41dda9564db96f6e36d1 and project bf95995343d547f78ae88a425f584ac7. Resources: {'cores', 'ram', 'instances'} {{(pid=117799) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:09:11.079448 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-54c63306-75ea-49d7-adcb-1a89f64f00c8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Going to run 1 instances... {{(pid=117799) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:09:11.082664 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-54c63306-75ea-49d7-adcb-1a89f64f00c8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5b5a68b4-38e3-4f05-b97f-4339d6752e34',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117799) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:09:11.229897 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-54c63306-75ea-49d7-adcb-1a89f64f00c8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.036016 May 26 15:09:11.235893 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 39/61] 10.222.0.45 () {60 vars in 1146 bytes} [Thu May 26 15:09:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 4038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 15:09:11.236362 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-aac2ced3-65d9-4189-8a47-a99664bc17e5 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:11.236997 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-aac2ced3-65d9-4189-8a47-a99664bc17e5 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:11.260708 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-aac2ced3-65d9-4189-8a47-a99664bc17e5 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:11.261197 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-aac2ced3-65d9-4189-8a47-a99664bc17e5 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:11.261987 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-aac2ced3-65d9-4189-8a47-a99664bc17e5 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:11.262432 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-aac2ced3-65d9-4189-8a47-a99664bc17e5 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:11.591209 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-aac2ced3-65d9-4189-8a47-a99664bc17e5 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a1284bc044e51923c72a9f8f41d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39490fef872043d1bfef791dd0bbb5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:11.604078 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-aac2ced3-65d9-4189-8a47-a99664bc17e5 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 200 len: 1314 microversion: 2.1 time: 0.371851 May 26 15:09:11.607854 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 40/62] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:11 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:11.660433 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-c122b22f-645e-4b1d-a7dd-f9339866127f tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1514638770", "imageRef": "5b5a68b4-38e3-4f05-b97f-4339d6752e34", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aeb58b02-96d6-4f2b-8272-441acfd1f591"}], "security_groups": [{"name": "tempest-securitygroup--845231619"}], "key_name": "tempest-keypair-1904351988", "user_data": "}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:11.924490 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-85735065-b952-41cf-af58-517ecf803f83 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Flavor limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:09:11.925134 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-85735065-b952-41cf-af58-517ecf803f83 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Image limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:09:11.925644 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-85735065-b952-41cf-af58-517ecf803f83 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Flavor pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:09:11.926154 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-85735065-b952-41cf-af58-517ecf803f83 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Image pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:09:11.926662 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-85735065-b952-41cf-af58-517ecf803f83 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:09:11.945559 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-85735065-b952-41cf-af58-517ecf803f83 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:11.946133 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-85735065-b952-41cf-af58-517ecf803f83 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:11.947216 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-85735065-b952-41cf-af58-517ecf803f83 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:11.947858 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-85735065-b952-41cf-af58-517ecf803f83 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:11.959118 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=47 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:11.995424 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-85735065-b952-41cf-af58-517ecf803f83 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Getting quotas for project 85ea8fbf32d748a8ad70996a9fa12843. Resources: {'cores', 'ram', 'instances'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:09:12.008343 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-85735065-b952-41cf-af58-517ecf803f83 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Getting quotas for user 9a671e0538ca45bbb44c298f1aa13a37 and project 85ea8fbf32d748a8ad70996a9fa12843. Resources: {'cores', 'ram', 'instances'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:09:12.037196 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-85735065-b952-41cf-af58-517ecf803f83 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Going to run 1 instances... {{(pid=117798) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:09:12.039934 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-85735065-b952-41cf-af58-517ecf803f83 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5b5a68b4-38e3-4f05-b97f-4339d6752e34',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:09:12.145297 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-85735065-b952-41cf-af58-517ecf803f83 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.766413 May 26 15:09:12.146408 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 23/63] 10.222.0.45 () {60 vars in 1146 bytes} [Thu May 26 15:09:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 2768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 15:09:12.167386 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e2166e27-4907-4d62-8d48-f436ab92910c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:12.168167 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e2166e27-4907-4d62-8d48-f436ab92910c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:12.185886 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.network.neutron [None req-c122b22f-645e-4b1d-a7dd-f9339866127f tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] validate_networks() for [('aeb58b02-96d6-4f2b-8272-441acfd1f591', None, None, None, None, None)] {{(pid=117799) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:09:12.358329 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e2166e27-4907-4d62-8d48-f436ab92910c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:12.394009 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e2166e27-4907-4d62-8d48-f436ab92910c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1221 microversion: 2.1 time: 0.246412 May 26 15:09:12.395042 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 24/64] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:12 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1221 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:12.428044 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-9e1ddde7-2b32-45b5-be5d-743e792c38f8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:12.429634 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-9e1ddde7-2b32-45b5-be5d-743e792c38f8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:12.793092 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-9e1ddde7-2b32-45b5-be5d-743e792c38f8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:12.813842 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-9e1ddde7-2b32-45b5-be5d-743e792c38f8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1237 microversion: 2.1 time: 0.406692 May 26 15:09:12.814649 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 25/65] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:12 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1237 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:12.831674 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-61b810d7-1fbb-4d4b-bcd0-b055c3fff2c6 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:12.834955 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-61b810d7-1fbb-4d4b-bcd0-b055c3fff2c6 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:12.852497 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-61b810d7-1fbb-4d4b-bcd0-b055c3fff2c6 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:12.857345 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-61b810d7-1fbb-4d4b-bcd0-b055c3fff2c6 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:12.863882 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-61b810d7-1fbb-4d4b-bcd0-b055c3fff2c6 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:12.864609 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-61b810d7-1fbb-4d4b-bcd0-b055c3fff2c6 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:13.839519 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-c122b22f-645e-4b1d-a7dd-f9339866127f tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Flavor limits 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:09:13.840929 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-c122b22f-645e-4b1d-a7dd-f9339866127f tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Image limits 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:09:13.841624 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-c122b22f-645e-4b1d-a7dd-f9339866127f tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Flavor pref 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:09:13.842808 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-c122b22f-645e-4b1d-a7dd-f9339866127f tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Image pref 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:09:13.844269 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-c122b22f-645e-4b1d-a7dd-f9339866127f tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:09:13.857911 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c122b22f-645e-4b1d-a7dd-f9339866127f tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:13.858550 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c122b22f-645e-4b1d-a7dd-f9339866127f tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:13.860175 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c122b22f-645e-4b1d-a7dd-f9339866127f tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:13.861045 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c122b22f-645e-4b1d-a7dd-f9339866127f tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:13.871838 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-61b810d7-1fbb-4d4b-bcd0-b055c3fff2c6 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a1284bc044e51923c72a9f8f41d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39490fef872043d1bfef791dd0bbb5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:13.881622 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-61b810d7-1fbb-4d4b-bcd0-b055c3fff2c6 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 200 len: 1314 microversion: 2.1 time: 1.065105 May 26 15:09:13.883743 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.quota [None req-c122b22f-645e-4b1d-a7dd-f9339866127f tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Getting quotas for project 196700c560cd4d6e9461ec9571facf39. Resources: {'cores', 'ram', 'instances'} {{(pid=117799) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:09:13.887935 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.quota [None req-c122b22f-645e-4b1d-a7dd-f9339866127f tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Getting quotas for user 1421fb674ae04d6ea9ae342b73ce8115 and project 196700c560cd4d6e9461ec9571facf39. Resources: {'cores', 'ram', 'instances'} {{(pid=117799) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:09:13.893072 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 26/66] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:12 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 1314 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:13.899001 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-8a74e09e-8a0f-47bb-bc86-3137408c77d4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-450822528", "imageRef": "5b5a68b4-38e3-4f05-b97f-4339d6752e34", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2ab2b37c-b216-46a4-aab4-9608db322f8a"}], "security_groups": [{"name": "tempest-securitygroup--1356195853"}], "key_name": "tempest-keypair-649054502", "user_data": "}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:13.902339 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-c122b22f-645e-4b1d-a7dd-f9339866127f tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Going to run 1 instances... {{(pid=117799) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:09:13.904809 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-c122b22f-645e-4b1d-a7dd-f9339866127f tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5b5a68b4-38e3-4f05-b97f-4339d6752e34',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117799) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:09:13.987156 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-c122b22f-645e-4b1d-a7dd-f9339866127f tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.376426 May 26 15:09:13.987806 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 41/67] 10.222.0.45 () {60 vars in 1146 bytes} [Thu May 26 15:09:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 2378 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 15:09:13.992548 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-f2837ffb-e83b-464e-b7e0-fcdff58d233a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:13.993153 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-f2837ffb-e83b-464e-b7e0-fcdff58d233a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:14.001775 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f2837ffb-e83b-464e-b7e0-fcdff58d233a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:14.002541 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f2837ffb-e83b-464e-b7e0-fcdff58d233a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:14.003289 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f2837ffb-e83b-464e-b7e0-fcdff58d233a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:14.003726 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f2837ffb-e83b-464e-b7e0-fcdff58d233a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:14.143583 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-f2837ffb-e83b-464e-b7e0-fcdff58d233a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:14.146707 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.network.neutron [None req-8a74e09e-8a0f-47bb-bc86-3137408c77d4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] validate_networks() for [('2ab2b37c-b216-46a4-aab4-9608db322f8a', None, None, None, None, None)] {{(pid=117798) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:09:14.158098 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-f2837ffb-e83b-464e-b7e0-fcdff58d233a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1279 microversion: 2.1 time: 0.168931 May 26 15:09:14.159549 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 42/68] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:13 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1279 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:14.165874 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-d8e6c2a1-4c77-4640-a20c-2f6361fb3feb tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:14.166503 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-d8e6c2a1-4c77-4640-a20c-2f6361fb3feb tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:14.178762 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d8e6c2a1-4c77-4640-a20c-2f6361fb3feb tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:14.179253 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d8e6c2a1-4c77-4640-a20c-2f6361fb3feb tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:14.180057 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d8e6c2a1-4c77-4640-a20c-2f6361fb3feb tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:14.180494 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d8e6c2a1-4c77-4640-a20c-2f6361fb3feb tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:14.301976 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-d8e6c2a1-4c77-4640-a20c-2f6361fb3feb tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:14.314772 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-d8e6c2a1-4c77-4640-a20c-2f6361fb3feb tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1289 microversion: 2.1 time: 0.153452 May 26 15:09:14.316071 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 43/69] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:14 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1289 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:14.331862 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-1e164bca-ee6c-426b-b8a2-adc2eb79d020 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:14.332692 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-1e164bca-ee6c-426b-b8a2-adc2eb79d020 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:14.443068 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-1e164bca-ee6c-426b-b8a2-adc2eb79d020 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:14.452733 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-1e164bca-ee6c-426b-b8a2-adc2eb79d020 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1242 microversion: 2.1 time: 0.134947 May 26 15:09:14.454371 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 44/70] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:14 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1242 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:14.772764 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-8a74e09e-8a0f-47bb-bc86-3137408c77d4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Flavor limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:09:14.773330 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-8a74e09e-8a0f-47bb-bc86-3137408c77d4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Image limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:09:14.773675 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-8a74e09e-8a0f-47bb-bc86-3137408c77d4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Flavor pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:09:14.774344 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-8a74e09e-8a0f-47bb-bc86-3137408c77d4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Image pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:09:14.774758 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-8a74e09e-8a0f-47bb-bc86-3137408c77d4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:09:14.785542 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8a74e09e-8a0f-47bb-bc86-3137408c77d4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:14.786239 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8a74e09e-8a0f-47bb-bc86-3137408c77d4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:14.786902 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8a74e09e-8a0f-47bb-bc86-3137408c77d4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:14.787370 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8a74e09e-8a0f-47bb-bc86-3137408c77d4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:14.806216 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-8a74e09e-8a0f-47bb-bc86-3137408c77d4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Getting quotas for project b9de893c8bbd47b59e136fe46e791a52. Resources: {'cores', 'ram', 'instances'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:09:14.810699 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-8a74e09e-8a0f-47bb-bc86-3137408c77d4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Getting quotas for user 1748648695bb46a9b2c7912c48e95bbd and project b9de893c8bbd47b59e136fe46e791a52. Resources: {'cores', 'ram', 'instances'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:09:14.823619 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-8a74e09e-8a0f-47bb-bc86-3137408c77d4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Going to run 1 instances... {{(pid=117798) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:09:14.825801 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-8a74e09e-8a0f-47bb-bc86-3137408c77d4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5b5a68b4-38e3-4f05-b97f-4339d6752e34',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:09:14.880493 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-8a74e09e-8a0f-47bb-bc86-3137408c77d4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.986105 May 26 15:09:14.881532 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 27/71] 10.222.0.45 () {62 vars in 1187 bytes} [Thu May 26 15:09:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 988 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 26 15:09:14.893058 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-396c9e52-6516-490f-a3ed-32fca4c30e9f tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:14.893813 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-396c9e52-6516-490f-a3ed-32fca4c30e9f tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:14.924020 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-39cd8507-f28f-483b-9c67-938e70442c46 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:14.924643 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-39cd8507-f28f-483b-9c67-938e70442c46 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:14.931485 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-39cd8507-f28f-483b-9c67-938e70442c46 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:14.932758 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-39cd8507-f28f-483b-9c67-938e70442c46 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:14.933698 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-39cd8507-f28f-483b-9c67-938e70442c46 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:14.934286 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-39cd8507-f28f-483b-9c67-938e70442c46 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:14.973034 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-396c9e52-6516-490f-a3ed-32fca4c30e9f tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:14.985559 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-396c9e52-6516-490f-a3ed-32fca4c30e9f tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:14.988280 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-396c9e52-6516-490f-a3ed-32fca4c30e9f tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:14.989754 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-396c9e52-6516-490f-a3ed-32fca4c30e9f tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1280 microversion: 2.20 time: 0.101695 May 26 15:09:14.991162 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 45/72] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:09:14 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1280 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:09:15.151531 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-39cd8507-f28f-483b-9c67-938e70442c46 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a1284bc044e51923c72a9f8f41d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39490fef872043d1bfef791dd0bbb5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:15.173662 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-39cd8507-f28f-483b-9c67-938e70442c46 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 200 len: 1314 microversion: 2.1 time: 0.269516 May 26 15:09:15.176512 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 28/73] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:14 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:15.192270 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-beecc793-6470-4d1a-b5be-68e5ddbef8d9 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:15.193062 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-beecc793-6470-4d1a-b5be-68e5ddbef8d9 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:15.202762 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-beecc793-6470-4d1a-b5be-68e5ddbef8d9 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:15.203493 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-beecc793-6470-4d1a-b5be-68e5ddbef8d9 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:15.204536 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-beecc793-6470-4d1a-b5be-68e5ddbef8d9 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:15.205171 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-beecc793-6470-4d1a-b5be-68e5ddbef8d9 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:15.292338 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-beecc793-6470-4d1a-b5be-68e5ddbef8d9 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:15.308457 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-beecc793-6470-4d1a-b5be-68e5ddbef8d9 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1279 microversion: 2.1 time: 0.133751 May 26 15:09:15.309975 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 46/74] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:15 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1279 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:09:15.336937 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f0d92391-8773-48cc-9cc3-668c4630cc7a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:15.338072 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f0d92391-8773-48cc-9cc3-668c4630cc7a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:15.351173 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f0d92391-8773-48cc-9cc3-668c4630cc7a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:15.351938 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f0d92391-8773-48cc-9cc3-668c4630cc7a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:15.353616 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f0d92391-8773-48cc-9cc3-668c4630cc7a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:15.354989 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f0d92391-8773-48cc-9cc3-668c4630cc7a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:15.444918 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f0d92391-8773-48cc-9cc3-668c4630cc7a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:15.457457 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f0d92391-8773-48cc-9cc3-668c4630cc7a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1289 microversion: 2.1 time: 0.126920 May 26 15:09:15.458254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 29/75] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:15 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1289 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:15.486230 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-48408edb-c8f3-453f-bba6-f574f1b4edc4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:15.486867 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-48408edb-c8f3-453f-bba6-f574f1b4edc4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:15.493490 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-48408edb-c8f3-453f-bba6-f574f1b4edc4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:15.493977 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-48408edb-c8f3-453f-bba6-f574f1b4edc4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:15.494763 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-48408edb-c8f3-453f-bba6-f574f1b4edc4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:15.495295 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-48408edb-c8f3-453f-bba6-f574f1b4edc4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:15.576139 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-48408edb-c8f3-453f-bba6-f574f1b4edc4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:15.587236 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-48408edb-c8f3-453f-bba6-f574f1b4edc4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1246 microversion: 2.1 time: 0.109023 May 26 15:09:15.588404 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 47/76] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:15 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1246 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:16.017378 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-6e427c50-d5dc-4996-b4c6-a1ec80722d5a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:16.018107 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-6e427c50-d5dc-4996-b4c6-a1ec80722d5a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:16.024880 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6e427c50-d5dc-4996-b4c6-a1ec80722d5a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:16.025419 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6e427c50-d5dc-4996-b4c6-a1ec80722d5a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:16.026242 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6e427c50-d5dc-4996-b4c6-a1ec80722d5a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:16.026715 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6e427c50-d5dc-4996-b4c6-a1ec80722d5a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:16.098461 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6e427c50-d5dc-4996-b4c6-a1ec80722d5a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:16.106549 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6e427c50-d5dc-4996-b4c6-a1ec80722d5a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:16.108901 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6e427c50-d5dc-4996-b4c6-a1ec80722d5a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:16.110739 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-6e427c50-d5dc-4996-b4c6-a1ec80722d5a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1284 microversion: 2.20 time: 0.097871 May 26 15:09:16.111351 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 30/77] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:09:16 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:09:16.195785 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-c81d6fb5-b30b-4d29-b33e-185f255fb46f tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:16.196410 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-c81d6fb5-b30b-4d29-b33e-185f255fb46f tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:16.202820 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c81d6fb5-b30b-4d29-b33e-185f255fb46f tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:16.203368 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c81d6fb5-b30b-4d29-b33e-185f255fb46f tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:16.204412 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c81d6fb5-b30b-4d29-b33e-185f255fb46f tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:16.204856 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c81d6fb5-b30b-4d29-b33e-185f255fb46f tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:16.326539 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-8e59050e-1b46-4173-b268-e554489298ec tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:16.327427 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-8e59050e-1b46-4173-b268-e554489298ec tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:16.336384 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8e59050e-1b46-4173-b268-e554489298ec tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:16.337042 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8e59050e-1b46-4173-b268-e554489298ec tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:16.338064 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8e59050e-1b46-4173-b268-e554489298ec tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:16.338641 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8e59050e-1b46-4173-b268-e554489298ec tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:16.364450 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-c81d6fb5-b30b-4d29-b33e-185f255fb46f tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a1284bc044e51923c72a9f8f41d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39490fef872043d1bfef791dd0bbb5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:16.374637 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-c81d6fb5-b30b-4d29-b33e-185f255fb46f tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 200 len: 1314 microversion: 2.1 time: 0.183346 May 26 15:09:16.384281 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 48/78] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:16 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:16.424011 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-8e59050e-1b46-4173-b268-e554489298ec tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:16.433206 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-8e59050e-1b46-4173-b268-e554489298ec tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1279 microversion: 2.1 time: 0.111210 May 26 15:09:16.433909 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 31/79] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:16 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1279 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:09:16.488041 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-9e2e94c5-17ec-444c-bc87-3cc4ae6fb9f4 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:16.488840 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-9e2e94c5-17ec-444c-bc87-3cc4ae6fb9f4 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:16.495348 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9e2e94c5-17ec-444c-bc87-3cc4ae6fb9f4 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:16.495821 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9e2e94c5-17ec-444c-bc87-3cc4ae6fb9f4 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:16.496591 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9e2e94c5-17ec-444c-bc87-3cc4ae6fb9f4 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:16.497023 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9e2e94c5-17ec-444c-bc87-3cc4ae6fb9f4 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:16.563660 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-9e2e94c5-17ec-444c-bc87-3cc4ae6fb9f4 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:16.571175 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-9e2e94c5-17ec-444c-bc87-3cc4ae6fb9f4 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1289 microversion: 2.1 time: 0.088340 May 26 15:09:16.571742 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 49/80] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:16 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1289 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:09:16.604922 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-83517be5-c293-4a65-b6c0-6c7da0feccd4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:16.605754 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-83517be5-c293-4a65-b6c0-6c7da0feccd4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:16.612535 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-83517be5-c293-4a65-b6c0-6c7da0feccd4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:16.612995 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-83517be5-c293-4a65-b6c0-6c7da0feccd4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:16.613765 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-83517be5-c293-4a65-b6c0-6c7da0feccd4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:16.614203 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-83517be5-c293-4a65-b6c0-6c7da0feccd4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:16.680179 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-83517be5-c293-4a65-b6c0-6c7da0feccd4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:16.688240 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-83517be5-c293-4a65-b6c0-6c7da0feccd4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1246 microversion: 2.1 time: 0.087113 May 26 15:09:16.688826 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 32/81] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:16 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:17.130513 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-ef0d4ca0-f17c-4bdc-8566-1904e583b92c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:17.131029 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-ef0d4ca0-f17c-4bdc-8566-1904e583b92c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:17.137056 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ef0d4ca0-f17c-4bdc-8566-1904e583b92c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:17.137689 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ef0d4ca0-f17c-4bdc-8566-1904e583b92c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:17.138548 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ef0d4ca0-f17c-4bdc-8566-1904e583b92c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:17.138989 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ef0d4ca0-f17c-4bdc-8566-1904e583b92c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:17.207748 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-ef0d4ca0-f17c-4bdc-8566-1904e583b92c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:17.215859 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-ef0d4ca0-f17c-4bdc-8566-1904e583b92c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:17.217392 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-ef0d4ca0-f17c-4bdc-8566-1904e583b92c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:17.218487 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-ef0d4ca0-f17c-4bdc-8566-1904e583b92c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1284 microversion: 2.20 time: 0.092053 May 26 15:09:17.219043 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 50/82] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:09:17 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:09:17.393608 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-9e6e2b7f-5338-4e81-a983-337c65ec418b tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:17.394252 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-9e6e2b7f-5338-4e81-a983-337c65ec418b tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:17.402709 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9e6e2b7f-5338-4e81-a983-337c65ec418b tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:17.403717 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9e6e2b7f-5338-4e81-a983-337c65ec418b tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:17.404744 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9e6e2b7f-5338-4e81-a983-337c65ec418b tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:17.405478 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9e6e2b7f-5338-4e81-a983-337c65ec418b tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:17.454017 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-9241f88c-f198-4c50-84ba-0939cc82cc37 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:17.455270 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-9241f88c-f198-4c50-84ba-0939cc82cc37 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:17.476911 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9241f88c-f198-4c50-84ba-0939cc82cc37 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:17.477364 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9241f88c-f198-4c50-84ba-0939cc82cc37 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:17.478154 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9241f88c-f198-4c50-84ba-0939cc82cc37 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:17.478592 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9241f88c-f198-4c50-84ba-0939cc82cc37 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:17.643969 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-9241f88c-f198-4c50-84ba-0939cc82cc37 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:17.656808 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-9241f88c-f198-4c50-84ba-0939cc82cc37 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1279 microversion: 2.1 time: 0.208657 May 26 15:09:17.657896 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 51/83] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:17 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1279 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:17.671451 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-2b563ca4-fcec-4301-9008-59b8e0a27002 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:17.672594 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-2b563ca4-fcec-4301-9008-59b8e0a27002 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:17.680358 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2b563ca4-fcec-4301-9008-59b8e0a27002 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:17.680809 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2b563ca4-fcec-4301-9008-59b8e0a27002 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:17.681589 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2b563ca4-fcec-4301-9008-59b8e0a27002 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:17.682020 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2b563ca4-fcec-4301-9008-59b8e0a27002 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:17.718321 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-9e6e2b7f-5338-4e81-a983-337c65ec418b tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a1284bc044e51923c72a9f8f41d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39490fef872043d1bfef791dd0bbb5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:17.736202 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-9e6e2b7f-5338-4e81-a983-337c65ec418b tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 200 len: 1314 microversion: 2.1 time: 0.347855 May 26 15:09:17.737461 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 33/84] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:17 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:17.742645 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-46461967-c7d7-4381-b9a3-42708dbeab7c tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:17.743484 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-46461967-c7d7-4381-b9a3-42708dbeab7c tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:17.756790 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-46461967-c7d7-4381-b9a3-42708dbeab7c tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:17.757412 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-46461967-c7d7-4381-b9a3-42708dbeab7c tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:17.759263 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-46461967-c7d7-4381-b9a3-42708dbeab7c tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:17.760013 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-46461967-c7d7-4381-b9a3-42708dbeab7c tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:17.789250 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-2b563ca4-fcec-4301-9008-59b8e0a27002 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:17.797281 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-2b563ca4-fcec-4301-9008-59b8e0a27002 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1297 microversion: 2.1 time: 0.137600 May 26 15:09:17.799752 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 52/85] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:17 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1297 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:17.845556 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-46461967-c7d7-4381-b9a3-42708dbeab7c tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:17.857477 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-46461967-c7d7-4381-b9a3-42708dbeab7c tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1238 microversion: 2.1 time: 0.117527 May 26 15:09:17.858632 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 34/86] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:17 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1238 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:18.238610 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-eafbcf39-1d4d-41a7-9dd8-5ae697e7f540 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:18.239449 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-eafbcf39-1d4d-41a7-9dd8-5ae697e7f540 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:18.246549 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-eafbcf39-1d4d-41a7-9dd8-5ae697e7f540 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:18.246989 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-eafbcf39-1d4d-41a7-9dd8-5ae697e7f540 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:18.247793 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-eafbcf39-1d4d-41a7-9dd8-5ae697e7f540 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:18.248224 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-eafbcf39-1d4d-41a7-9dd8-5ae697e7f540 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:18.344920 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-eafbcf39-1d4d-41a7-9dd8-5ae697e7f540 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:18.356004 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-eafbcf39-1d4d-41a7-9dd8-5ae697e7f540 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:18.357821 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-eafbcf39-1d4d-41a7-9dd8-5ae697e7f540 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:18.359931 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-eafbcf39-1d4d-41a7-9dd8-5ae697e7f540 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1332 microversion: 2.20 time: 0.126478 May 26 15:09:18.361070 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 53/87] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:09:18 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1332 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:09:18.675913 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-81d4ad25-7616-4d4c-8990-bce6cc28091f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:18.676944 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-81d4ad25-7616-4d4c-8990-bce6cc28091f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:18.684132 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-81d4ad25-7616-4d4c-8990-bce6cc28091f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:18.684534 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-81d4ad25-7616-4d4c-8990-bce6cc28091f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:18.685348 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-81d4ad25-7616-4d4c-8990-bce6cc28091f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:18.686023 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-81d4ad25-7616-4d4c-8990-bce6cc28091f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:18.756959 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-60f41709-8ef8-4ff0-8c2c-b0121db587a2 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:18.758127 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-60f41709-8ef8-4ff0-8c2c-b0121db587a2 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:18.768482 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-60f41709-8ef8-4ff0-8c2c-b0121db587a2 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:18.768931 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-60f41709-8ef8-4ff0-8c2c-b0121db587a2 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:18.770121 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-60f41709-8ef8-4ff0-8c2c-b0121db587a2 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:18.770890 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-60f41709-8ef8-4ff0-8c2c-b0121db587a2 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:18.776578 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=99 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:18.808426 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-81d4ad25-7616-4d4c-8990-bce6cc28091f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:18.840901 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-81d4ad25-7616-4d4c-8990-bce6cc28091f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1279 microversion: 2.1 time: 0.170192 May 26 15:09:18.849219 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 35/88] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:18 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1279 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:18.856984 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-27ed3241-61cc-436d-ab1d-b0641a331593 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:18.860170 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-27ed3241-61cc-436d-ab1d-b0641a331593 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:18.877039 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-27ed3241-61cc-436d-ab1d-b0641a331593 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:18.877487 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-27ed3241-61cc-436d-ab1d-b0641a331593 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:18.878273 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-27ed3241-61cc-436d-ab1d-b0641a331593 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:18.883441 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-27ed3241-61cc-436d-ab1d-b0641a331593 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:19.521225 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-27ed3241-61cc-436d-ab1d-b0641a331593 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:19.531080 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-27ed3241-61cc-436d-ab1d-b0641a331593 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1295 microversion: 2.1 time: 0.680405 May 26 15:09:19.543117 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 36/89] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:18 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1295 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:19.553181 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a354e5f0-aa35-436d-ac97-e7d00ad88b0e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:19.553805 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a354e5f0-aa35-436d-ac97-e7d00ad88b0e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:19.567475 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a354e5f0-aa35-436d-ac97-e7d00ad88b0e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:19.567919 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a354e5f0-aa35-436d-ac97-e7d00ad88b0e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:19.570935 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a354e5f0-aa35-436d-ac97-e7d00ad88b0e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:19.574864 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a354e5f0-aa35-436d-ac97-e7d00ad88b0e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:19.868632 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a354e5f0-aa35-436d-ac97-e7d00ad88b0e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:19.880756 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a354e5f0-aa35-436d-ac97-e7d00ad88b0e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1300 microversion: 2.1 time: 0.336420 May 26 15:09:19.885789 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 37/90] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:19 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1300 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:19.902059 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-c9f8fbf0-fe9e-4700-bae6-c7de35d2cd54 req-8899f229-5370-4704-bdcf-66f1df539ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab471a8e-c724-4c71-b9ce-b253771d23a1", "tag": "fb04c6b8-9901-4e4f-acc2-c4c580e85f3e"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:19.959584 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-c9f8fbf0-fe9e-4700-bae6-c7de35d2cd54 req-8899f229-5370-4704-bdcf-66f1df539ff1 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:19.960332 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-c9f8fbf0-fe9e-4700-bae6-c7de35d2cd54 req-8899f229-5370-4704-bdcf-66f1df539ff1 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:20.008478 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-c9f8fbf0-fe9e-4700-bae6-c7de35d2cd54 req-8899f229-5370-4704-bdcf-66f1df539ff1 service nova] Creating event network-changed:fb04c6b8-9901-4e4f-acc2-c4c580e85f3e for instance ab471a8e-c724-4c71-b9ce-b253771d23a1 on hv-cinder-84301 May 26 15:09:20.009463 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-c9f8fbf0-fe9e-4700-bae6-c7de35d2cd54 req-8899f229-5370-4704-bdcf-66f1df539ff1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117798) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 26 15:09:20.014181 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5e29dbe9-33b6-49b2-9cb8-8b7dbe977e05 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:20.015880 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5e29dbe9-33b6-49b2-9cb8-8b7dbe977e05 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:20.017016 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5e29dbe9-33b6-49b2-9cb8-8b7dbe977e05 None None] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:20.019478 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5e29dbe9-33b6-49b2-9cb8-8b7dbe977e05 None None] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:20.066573 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.compute.rpcapi [None req-5e29dbe9-33b6-49b2-9cb8-8b7dbe977e05 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 26 15:09:20.070328 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5e29dbe9-33b6-49b2-9cb8-8b7dbe977e05 None None] Releasing lock "compute-rpcapi-router" {{(pid=117798) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 26 15:09:20.114294 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-5e29dbe9-33b6-49b2-9cb8-8b7dbe977e05 None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.216390 May 26 15:09:20.115618 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 38/91] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:09:20.121691 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-60f41709-8ef8-4ff0-8c2c-b0121db587a2 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a1284bc044e51923c72a9f8f41d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39490fef872043d1bfef791dd0bbb5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:20.133784 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-12e7a564-e4a7-4e26-9f9b-f4a3502b2c8a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:20.134606 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-12e7a564-e4a7-4e26-9f9b-f4a3502b2c8a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:20.137751 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-60f41709-8ef8-4ff0-8c2c-b0121db587a2 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 200 len: 1314 microversion: 2.1 time: 1.387615 May 26 15:09:20.148587 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-12e7a564-e4a7-4e26-9f9b-f4a3502b2c8a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:20.149615 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-12e7a564-e4a7-4e26-9f9b-f4a3502b2c8a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:20.150540 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-12e7a564-e4a7-4e26-9f9b-f4a3502b2c8a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:20.151189 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-12e7a564-e4a7-4e26-9f9b-f4a3502b2c8a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:20.157700 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 54/92] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:18 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 1314 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:09:20.178760 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-9b151e1f-5238-4441-bd1d-97750b8193f6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:20.182126 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-9b151e1f-5238-4441-bd1d-97750b8193f6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:20.197727 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9b151e1f-5238-4441-bd1d-97750b8193f6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:20.200407 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9b151e1f-5238-4441-bd1d-97750b8193f6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:20.201321 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9b151e1f-5238-4441-bd1d-97750b8193f6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:20.203616 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9b151e1f-5238-4441-bd1d-97750b8193f6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:20.272495 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-12e7a564-e4a7-4e26-9f9b-f4a3502b2c8a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:20.283183 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-12e7a564-e4a7-4e26-9f9b-f4a3502b2c8a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:20.284689 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-12e7a564-e4a7-4e26-9f9b-f4a3502b2c8a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:20.285802 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-12e7a564-e4a7-4e26-9f9b-f4a3502b2c8a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1338 microversion: 2.20 time: 0.168840 May 26 15:09:20.286508 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 39/93] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:09:20 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1338 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:09:20.411765 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-97ad86f5-7b6f-4a9d-95a3-a84246c1adde req-dc355a9c-1c66-4e7f-b5a1-0823662020e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8045b554-0891-4c2c-a842-76b806f8e817", "name": "network-vif-plugged", "status": "completed", "tag": "e06f6e86-12f3-4048-8f36-e642cd36ea4a"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:20.427671 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-97ad86f5-7b6f-4a9d-95a3-a84246c1adde req-dc355a9c-1c66-4e7f-b5a1-0823662020e1 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:20.428396 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-97ad86f5-7b6f-4a9d-95a3-a84246c1adde req-dc355a9c-1c66-4e7f-b5a1-0823662020e1 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:20.449124 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-97ad86f5-7b6f-4a9d-95a3-a84246c1adde req-dc355a9c-1c66-4e7f-b5a1-0823662020e1 service nova] Creating event network-vif-plugged:e06f6e86-12f3-4048-8f36-e642cd36ea4a for instance 8045b554-0891-4c2c-a842-76b806f8e817 on hv-cinder-84301 May 26 15:09:20.455826 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-97ad86f5-7b6f-4a9d-95a3-a84246c1adde req-dc355a9c-1c66-4e7f-b5a1-0823662020e1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167915 May 26 15:09:20.456749 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 40/94] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:09:20.553893 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-510caee7-4f6d-4bf8-a076-b301495be013 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:20.554703 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-510caee7-4f6d-4bf8-a076-b301495be013 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:20.566474 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-510caee7-4f6d-4bf8-a076-b301495be013 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:20.567014 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-510caee7-4f6d-4bf8-a076-b301495be013 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:20.571666 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-510caee7-4f6d-4bf8-a076-b301495be013 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:20.575211 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-510caee7-4f6d-4bf8-a076-b301495be013 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:20.588828 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-9b151e1f-5238-4441-bd1d-97750b8193f6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:20.601166 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-9b151e1f-5238-4441-bd1d-97750b8193f6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1321 microversion: 2.1 time: 0.441761 May 26 15:09:20.614363 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 55/95] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:20 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1321 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:20.818780 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-510caee7-4f6d-4bf8-a076-b301495be013 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:20.829520 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-510caee7-4f6d-4bf8-a076-b301495be013 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1362 microversion: 2.1 time: 0.285098 May 26 15:09:20.831288 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 41/96] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:20 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1362 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:20.910547 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-4452a43f-7688-456e-86e5-f9fb70b04474 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:20.911301 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-4452a43f-7688-456e-86e5-f9fb70b04474 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:20.918002 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4452a43f-7688-456e-86e5-f9fb70b04474 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:20.918522 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4452a43f-7688-456e-86e5-f9fb70b04474 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:20.919291 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4452a43f-7688-456e-86e5-f9fb70b04474 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:20.919720 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4452a43f-7688-456e-86e5-f9fb70b04474 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:20.984786 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-4452a43f-7688-456e-86e5-f9fb70b04474 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:20.992507 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-4452a43f-7688-456e-86e5-f9fb70b04474 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1300 microversion: 2.1 time: 0.086837 May 26 15:09:20.993051 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 56/97] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:20 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1300 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:21.159879 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c2b6ad47-c672-48ba-9ad1-8bf2452a7cbb tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:21.160492 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c2b6ad47-c672-48ba-9ad1-8bf2452a7cbb tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:21.166679 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c2b6ad47-c672-48ba-9ad1-8bf2452a7cbb tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:21.167152 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c2b6ad47-c672-48ba-9ad1-8bf2452a7cbb tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:21.167909 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c2b6ad47-c672-48ba-9ad1-8bf2452a7cbb tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:21.168372 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c2b6ad47-c672-48ba-9ad1-8bf2452a7cbb tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:21.297873 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c2b6ad47-c672-48ba-9ad1-8bf2452a7cbb tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a1284bc044e51923c72a9f8f41d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39490fef872043d1bfef791dd0bbb5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:21.304438 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-411cce9f-cbef-4fcc-81ff-32fc35649e52 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:21.305039 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-411cce9f-cbef-4fcc-81ff-32fc35649e52 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:21.305708 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c2b6ad47-c672-48ba-9ad1-8bf2452a7cbb tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 200 len: 1314 microversion: 2.1 time: 0.150719 May 26 15:09:21.306286 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 42/98] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:21 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:21.311025 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-411cce9f-cbef-4fcc-81ff-32fc35649e52 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:21.311499 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-411cce9f-cbef-4fcc-81ff-32fc35649e52 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:21.312299 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-411cce9f-cbef-4fcc-81ff-32fc35649e52 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:21.313110 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-411cce9f-cbef-4fcc-81ff-32fc35649e52 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:21.377673 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-411cce9f-cbef-4fcc-81ff-32fc35649e52 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:21.385533 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-411cce9f-cbef-4fcc-81ff-32fc35649e52 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:21.387013 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-411cce9f-cbef-4fcc-81ff-32fc35649e52 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:21.388136 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-411cce9f-cbef-4fcc-81ff-32fc35649e52 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1338 microversion: 2.20 time: 0.087498 May 26 15:09:21.388693 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 57/99] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:09:21 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1338 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:09:21.618782 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-bf9cee40-28e9-4a7e-b4cc-31c4cd2ce965 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:21.619408 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-bf9cee40-28e9-4a7e-b4cc-31c4cd2ce965 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:21.626130 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bf9cee40-28e9-4a7e-b4cc-31c4cd2ce965 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:21.626572 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bf9cee40-28e9-4a7e-b4cc-31c4cd2ce965 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:21.627355 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bf9cee40-28e9-4a7e-b4cc-31c4cd2ce965 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:21.627787 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bf9cee40-28e9-4a7e-b4cc-31c4cd2ce965 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:21.757666 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-bf9cee40-28e9-4a7e-b4cc-31c4cd2ce965 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:21.765078 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-bf9cee40-28e9-4a7e-b4cc-31c4cd2ce965 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1321 microversion: 2.1 time: 0.150078 May 26 15:09:21.766243 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 43/100] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:21 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:21.848013 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-ee515f2e-16b5-4908-a097-34be4efa38d6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:21.848545 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-ee515f2e-16b5-4908-a097-34be4efa38d6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:21.854670 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ee515f2e-16b5-4908-a097-34be4efa38d6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:21.855138 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ee515f2e-16b5-4908-a097-34be4efa38d6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:21.855911 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ee515f2e-16b5-4908-a097-34be4efa38d6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:21.856345 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ee515f2e-16b5-4908-a097-34be4efa38d6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:21.992816 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-ee515f2e-16b5-4908-a097-34be4efa38d6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:22.001143 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-ee515f2e-16b5-4908-a097-34be4efa38d6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1362 microversion: 2.1 time: 0.157077 May 26 15:09:22.001709 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 58/101] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:21 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:22.008886 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1230ba8a-12e7-4097-b7ea-d8a7c3bfcc8b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:22.009487 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1230ba8a-12e7-4097-b7ea-d8a7c3bfcc8b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:22.016057 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1230ba8a-12e7-4097-b7ea-d8a7c3bfcc8b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:22.016744 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1230ba8a-12e7-4097-b7ea-d8a7c3bfcc8b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:22.020045 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1230ba8a-12e7-4097-b7ea-d8a7c3bfcc8b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:22.020045 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1230ba8a-12e7-4097-b7ea-d8a7c3bfcc8b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:22.020785 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=100 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:22.082092 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1230ba8a-12e7-4097-b7ea-d8a7c3bfcc8b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:22.089392 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1230ba8a-12e7-4097-b7ea-d8a7c3bfcc8b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1300 microversion: 2.1 time: 0.084261 May 26 15:09:22.089951 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 44/102] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:22 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1300 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:22.130673 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-16d070e0-3e36-42b7-9365-fd39da6c85ad req-97e31df4-f467-4000-a17c-dc66f187621c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44b285a0-afad-471d-8d28-7e8972acca1a", "tag": "c2e407fa-92ac-42e8-af38-3255afe28425"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:22.138931 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-16d070e0-3e36-42b7-9365-fd39da6c85ad req-97e31df4-f467-4000-a17c-dc66f187621c service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:22.139409 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-16d070e0-3e36-42b7-9365-fd39da6c85ad req-97e31df4-f467-4000-a17c-dc66f187621c service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:22.151357 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-16d070e0-3e36-42b7-9365-fd39da6c85ad req-97e31df4-f467-4000-a17c-dc66f187621c service nova] Creating event network-changed:c2e407fa-92ac-42e8-af38-3255afe28425 for instance 44b285a0-afad-471d-8d28-7e8972acca1a on hv-cinder-84301 May 26 15:09:22.156830 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-16d070e0-3e36-42b7-9365-fd39da6c85ad req-97e31df4-f467-4000-a17c-dc66f187621c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029200 May 26 15:09:22.157426 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 59/103] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:09:22.322623 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b362d58f-2ece-42a3-8953-87f117077c3c tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:22.323334 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b362d58f-2ece-42a3-8953-87f117077c3c tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:22.330490 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b362d58f-2ece-42a3-8953-87f117077c3c tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:22.330938 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b362d58f-2ece-42a3-8953-87f117077c3c tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:22.331741 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b362d58f-2ece-42a3-8953-87f117077c3c tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:22.332182 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b362d58f-2ece-42a3-8953-87f117077c3c tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:22.407795 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-6c1a2dfe-d090-4bc1-9f00-aaceac83deba tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:22.408510 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-6c1a2dfe-d090-4bc1-9f00-aaceac83deba tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:22.414770 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6c1a2dfe-d090-4bc1-9f00-aaceac83deba tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:22.415241 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6c1a2dfe-d090-4bc1-9f00-aaceac83deba tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:22.416013 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6c1a2dfe-d090-4bc1-9f00-aaceac83deba tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:22.416426 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6c1a2dfe-d090-4bc1-9f00-aaceac83deba tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:22.474380 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b362d58f-2ece-42a3-8953-87f117077c3c tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a1284bc044e51923c72a9f8f41d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39490fef872043d1bfef791dd0bbb5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:22.481724 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b362d58f-2ece-42a3-8953-87f117077c3c tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 200 len: 1314 microversion: 2.1 time: 0.163762 May 26 15:09:22.482287 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 45/104] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:22 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:22.489990 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-6c1a2dfe-d090-4bc1-9f00-aaceac83deba tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:22.498044 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-6c1a2dfe-d090-4bc1-9f00-aaceac83deba tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:22.500243 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-6c1a2dfe-d090-4bc1-9f00-aaceac83deba tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:22.501542 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-6c1a2dfe-d090-4bc1-9f00-aaceac83deba tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1338 microversion: 2.20 time: 0.098794 May 26 15:09:22.502057 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 60/105] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:09:22 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1338 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:09:22.782538 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-9d7a0bc2-398a-4e02-8150-ed6a421159ae tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:22.783159 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-9d7a0bc2-398a-4e02-8150-ed6a421159ae tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:22.789121 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9d7a0bc2-398a-4e02-8150-ed6a421159ae tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:22.789565 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9d7a0bc2-398a-4e02-8150-ed6a421159ae tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:22.790316 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9d7a0bc2-398a-4e02-8150-ed6a421159ae tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:22.790745 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9d7a0bc2-398a-4e02-8150-ed6a421159ae tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:22.922835 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-9d7a0bc2-398a-4e02-8150-ed6a421159ae tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:22.930206 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-9d7a0bc2-398a-4e02-8150-ed6a421159ae tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1321 microversion: 2.1 time: 0.151615 May 26 15:09:22.930779 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 46/106] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:22 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:23.018356 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-83d989ce-d078-4b60-bcbc-e97508f98135 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:23.018854 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-83d989ce-d078-4b60-bcbc-e97508f98135 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:23.025052 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-83d989ce-d078-4b60-bcbc-e97508f98135 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:23.025499 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-83d989ce-d078-4b60-bcbc-e97508f98135 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:23.026258 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-83d989ce-d078-4b60-bcbc-e97508f98135 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:23.032711 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-83d989ce-d078-4b60-bcbc-e97508f98135 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:23.107013 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f96851bb-0d11-4b70-9d5f-0b6bc3119a83 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:23.107834 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f96851bb-0d11-4b70-9d5f-0b6bc3119a83 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:23.114468 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f96851bb-0d11-4b70-9d5f-0b6bc3119a83 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:23.114912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f96851bb-0d11-4b70-9d5f-0b6bc3119a83 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:23.115707 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f96851bb-0d11-4b70-9d5f-0b6bc3119a83 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:23.116138 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f96851bb-0d11-4b70-9d5f-0b6bc3119a83 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:23.167302 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-83d989ce-d078-4b60-bcbc-e97508f98135 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:23.175458 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-83d989ce-d078-4b60-bcbc-e97508f98135 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1362 microversion: 2.1 time: 0.161250 May 26 15:09:23.176037 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 61/107] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:23 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:23.183132 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f96851bb-0d11-4b70-9d5f-0b6bc3119a83 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:23.190667 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f96851bb-0d11-4b70-9d5f-0b6bc3119a83 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1300 microversion: 2.1 time: 0.087491 May 26 15:09:23.191265 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 47/108] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:23 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1300 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:09:23.498117 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-396c08d7-a160-472e-8964-3fe95abc1fe0 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:23.498740 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-396c08d7-a160-472e-8964-3fe95abc1fe0 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:23.505417 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-396c08d7-a160-472e-8964-3fe95abc1fe0 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:23.505960 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-396c08d7-a160-472e-8964-3fe95abc1fe0 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:23.506852 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-396c08d7-a160-472e-8964-3fe95abc1fe0 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:23.507374 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-396c08d7-a160-472e-8964-3fe95abc1fe0 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:23.519400 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-74b47734-68d4-434b-9bf1-47ecfbd06e1e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:23.520882 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-74b47734-68d4-434b-9bf1-47ecfbd06e1e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:23.527382 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-74b47734-68d4-434b-9bf1-47ecfbd06e1e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:23.527829 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-74b47734-68d4-434b-9bf1-47ecfbd06e1e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:23.528590 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-74b47734-68d4-434b-9bf1-47ecfbd06e1e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:23.529022 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-74b47734-68d4-434b-9bf1-47ecfbd06e1e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:23.622696 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-74b47734-68d4-434b-9bf1-47ecfbd06e1e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:23.633841 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-74b47734-68d4-434b-9bf1-47ecfbd06e1e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:23.636001 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-74b47734-68d4-434b-9bf1-47ecfbd06e1e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:23.637717 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-74b47734-68d4-434b-9bf1-47ecfbd06e1e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1338 microversion: 2.20 time: 0.121904 May 26 15:09:23.639017 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 48/109] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:09:23 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1338 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:09:23.752378 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-396c08d7-a160-472e-8964-3fe95abc1fe0 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a1284bc044e51923c72a9f8f41d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39490fef872043d1bfef791dd0bbb5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:23.761880 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-396c08d7-a160-472e-8964-3fe95abc1fe0 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 200 len: 1314 microversion: 2.1 time: 0.267890 May 26 15:09:23.762463 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 62/110] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:23 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:23.948007 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-3365f437-5837-42d0-be8f-f3dfb86a915b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:23.948607 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-3365f437-5837-42d0-be8f-f3dfb86a915b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:23.956167 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3365f437-5837-42d0-be8f-f3dfb86a915b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:23.957355 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3365f437-5837-42d0-be8f-f3dfb86a915b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:23.958104 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3365f437-5837-42d0-be8f-f3dfb86a915b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:23.961808 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3365f437-5837-42d0-be8f-f3dfb86a915b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:24.193416 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-4c84e442-64fa-4536-88cd-910d971d062e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:24.194035 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-4c84e442-64fa-4536-88cd-910d971d062e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:24.197487 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell0:SELECT=6 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:24.207638 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4c84e442-64fa-4536-88cd-910d971d062e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:24.208121 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4c84e442-64fa-4536-88cd-910d971d062e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:24.208902 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4c84e442-64fa-4536-88cd-910d971d062e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:24.209334 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4c84e442-64fa-4536-88cd-910d971d062e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:24.536941 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-3365f437-5837-42d0-be8f-f3dfb86a915b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:24.548834 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-3365f437-5837-42d0-be8f-f3dfb86a915b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1321 microversion: 2.1 time: 0.604552 May 26 15:09:24.559400 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 49/111] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:23 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1321 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:24.566135 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-84e32290-2bc4-4dbd-95d8-91a6b3a6b1c6 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:24.567035 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-84e32290-2bc4-4dbd-95d8-91a6b3a6b1c6 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:24.575481 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-84e32290-2bc4-4dbd-95d8-91a6b3a6b1c6 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:24.576350 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-84e32290-2bc4-4dbd-95d8-91a6b3a6b1c6 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:24.577318 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-84e32290-2bc4-4dbd-95d8-91a6b3a6b1c6 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:24.580018 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-84e32290-2bc4-4dbd-95d8-91a6b3a6b1c6 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:24.598963 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-4c84e442-64fa-4536-88cd-910d971d062e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:24.611443 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-4c84e442-64fa-4536-88cd-910d971d062e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1362 microversion: 2.1 time: 0.421689 May 26 15:09:24.619148 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 63/112] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:24 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1362 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:24.671350 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-dd790216-dc09-4674-9c0f-c61fd3137be2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:24.676241 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-dd790216-dc09-4674-9c0f-c61fd3137be2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:24.685597 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dd790216-dc09-4674-9c0f-c61fd3137be2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:24.686273 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dd790216-dc09-4674-9c0f-c61fd3137be2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:24.687922 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dd790216-dc09-4674-9c0f-c61fd3137be2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:24.689373 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dd790216-dc09-4674-9c0f-c61fd3137be2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:24.706320 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-84e32290-2bc4-4dbd-95d8-91a6b3a6b1c6 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:24.723994 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-84e32290-2bc4-4dbd-95d8-91a6b3a6b1c6 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1300 microversion: 2.1 time: 0.163087 May 26 15:09:24.725220 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 50/113] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:24 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1300 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:24.785161 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-59974a27-fbbb-427a-99cf-86418880aa7e tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:24.785898 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-59974a27-fbbb-427a-99cf-86418880aa7e tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:24.796083 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-59974a27-fbbb-427a-99cf-86418880aa7e tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:24.796681 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-59974a27-fbbb-427a-99cf-86418880aa7e tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:24.797486 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-59974a27-fbbb-427a-99cf-86418880aa7e tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:24.798355 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-59974a27-fbbb-427a-99cf-86418880aa7e tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:24.800313 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-dd790216-dc09-4674-9c0f-c61fd3137be2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:24.813964 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-dd790216-dc09-4674-9c0f-c61fd3137be2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:24.816445 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-dd790216-dc09-4674-9c0f-c61fd3137be2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:24.818036 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-dd790216-dc09-4674-9c0f-c61fd3137be2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1338 microversion: 2.20 time: 0.163864 May 26 15:09:24.819299 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 64/114] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:09:24 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1338 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:09:24.830678 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=22 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:25.079371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-59974a27-fbbb-427a-99cf-86418880aa7e tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a1284bc044e51923c72a9f8f41d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39490fef872043d1bfef791dd0bbb5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:25.089985 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-59974a27-fbbb-427a-99cf-86418880aa7e tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 200 len: 1314 microversion: 2.1 time: 0.311488 May 26 15:09:25.090580 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 51/115] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:24 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:25.385462 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell0:SELECT=30 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:25.502159 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-8d38edea-c1a1-433a-88fc-6621756bf4e4 req-8d4598e9-bcd2-4c58-94ab-d2d15e98b6bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29d9c670-e34a-4363-9e60-745335a3ea6c", "tag": "594748ba-cf8f-4cb8-bfc4-dba073613057"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:25.510999 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-8d38edea-c1a1-433a-88fc-6621756bf4e4 req-8d4598e9-bcd2-4c58-94ab-d2d15e98b6bd service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:25.511532 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-8d38edea-c1a1-433a-88fc-6621756bf4e4 req-8d4598e9-bcd2-4c58-94ab-d2d15e98b6bd service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:25.529079 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-8d38edea-c1a1-433a-88fc-6621756bf4e4 req-8d4598e9-bcd2-4c58-94ab-d2d15e98b6bd service nova] Creating event network-changed:594748ba-cf8f-4cb8-bfc4-dba073613057 for instance 29d9c670-e34a-4363-9e60-745335a3ea6c on hv-cinder-84301 May 26 15:09:25.534901 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-8d38edea-c1a1-433a-88fc-6621756bf4e4 req-8d4598e9-bcd2-4c58-94ab-d2d15e98b6bd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155160 May 26 15:09:25.535785 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 65/116] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:09:25.569289 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-09235c84-de1e-4193-a417-03adb4bcb12e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:25.573841 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-09235c84-de1e-4193-a417-03adb4bcb12e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:25.587672 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-09235c84-de1e-4193-a417-03adb4bcb12e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:25.592941 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-09235c84-de1e-4193-a417-03adb4bcb12e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:25.593947 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-09235c84-de1e-4193-a417-03adb4bcb12e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:25.594466 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-09235c84-de1e-4193-a417-03adb4bcb12e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:25.632712 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-e65e7a23-7867-4503-be1d-66d823786b42 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:25.634125 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-e65e7a23-7867-4503-be1d-66d823786b42 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:25.647672 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e65e7a23-7867-4503-be1d-66d823786b42 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:25.648568 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e65e7a23-7867-4503-be1d-66d823786b42 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:25.650253 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e65e7a23-7867-4503-be1d-66d823786b42 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:25.651316 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e65e7a23-7867-4503-be1d-66d823786b42 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:25.834246 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-09235c84-de1e-4193-a417-03adb4bcb12e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:25.842183 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-09235c84-de1e-4193-a417-03adb4bcb12e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1321 microversion: 2.1 time: 0.277737 May 26 15:09:25.842885 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 52/117] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:25 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1321 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:25.848821 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-85920a90-a997-4e26-a321-fa12046dbe41 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:25.849459 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-85920a90-a997-4e26-a321-fa12046dbe41 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:25.858167 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-85920a90-a997-4e26-a321-fa12046dbe41 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:25.858581 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-85920a90-a997-4e26-a321-fa12046dbe41 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:25.859590 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-85920a90-a997-4e26-a321-fa12046dbe41 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:25.860197 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-85920a90-a997-4e26-a321-fa12046dbe41 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:25.865393 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-e65e7a23-7867-4503-be1d-66d823786b42 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:25.872863 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-e65e7a23-7867-4503-be1d-66d823786b42 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1362 microversion: 2.1 time: 0.246224 May 26 15:09:25.873439 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 66/118] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:25 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:09:25.878147 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-6c0b7349-91d4-4f14-9477-f88b4edaab81 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:25.878754 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-6c0b7349-91d4-4f14-9477-f88b4edaab81 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:25.885270 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6c0b7349-91d4-4f14-9477-f88b4edaab81 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:25.885730 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6c0b7349-91d4-4f14-9477-f88b4edaab81 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:25.886492 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6c0b7349-91d4-4f14-9477-f88b4edaab81 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:25.886926 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6c0b7349-91d4-4f14-9477-f88b4edaab81 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:26.059477 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-85920a90-a997-4e26-a321-fa12046dbe41 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:26.066547 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-6c0b7349-91d4-4f14-9477-f88b4edaab81 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:26.067976 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-85920a90-a997-4e26-a321-fa12046dbe41 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1367 microversion: 2.1 time: 0.222847 May 26 15:09:26.068595 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 53/119] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:25 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:26.074611 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-6c0b7349-91d4-4f14-9477-f88b4edaab81 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:26.076123 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-6c0b7349-91d4-4f14-9477-f88b4edaab81 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:26.077216 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-6c0b7349-91d4-4f14-9477-f88b4edaab81 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1406 microversion: 2.20 time: 0.202869 May 26 15:09:26.078575 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 67/120] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:09:25 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1406 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:09:26.107212 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e21b94bc-c32c-46ad-b676-3d6ab0d11bed tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:26.107877 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e21b94bc-c32c-46ad-b676-3d6ab0d11bed tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:26.113978 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e21b94bc-c32c-46ad-b676-3d6ab0d11bed tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:26.114423 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e21b94bc-c32c-46ad-b676-3d6ab0d11bed tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:26.115212 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e21b94bc-c32c-46ad-b676-3d6ab0d11bed tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:26.115649 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e21b94bc-c32c-46ad-b676-3d6ab0d11bed tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:26.247030 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e21b94bc-c32c-46ad-b676-3d6ab0d11bed tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a1284bc044e51923c72a9f8f41d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39490fef872043d1bfef791dd0bbb5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:26.254877 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e21b94bc-c32c-46ad-b676-3d6ab0d11bed tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 200 len: 1314 microversion: 2.1 time: 0.151839 May 26 15:09:26.255481 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 54/121] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:26 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:09:26.860826 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-44304224-2273-4e31-b8f1-52c8ee218ddc tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:26.861394 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-44304224-2273-4e31-b8f1-52c8ee218ddc tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:26.868258 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-44304224-2273-4e31-b8f1-52c8ee218ddc tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:26.868788 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-44304224-2273-4e31-b8f1-52c8ee218ddc tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:26.869669 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-44304224-2273-4e31-b8f1-52c8ee218ddc tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:26.870163 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-44304224-2273-4e31-b8f1-52c8ee218ddc tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:26.889818 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-7c09968a-0f99-4e04-8fc6-7f384758aa4d tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:26.891646 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-7c09968a-0f99-4e04-8fc6-7f384758aa4d tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:26.897914 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7c09968a-0f99-4e04-8fc6-7f384758aa4d tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:26.898363 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7c09968a-0f99-4e04-8fc6-7f384758aa4d tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:26.899417 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7c09968a-0f99-4e04-8fc6-7f384758aa4d tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:26.899853 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7c09968a-0f99-4e04-8fc6-7f384758aa4d tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:27.075024 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-44304224-2273-4e31-b8f1-52c8ee218ddc tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:27.083699 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-44304224-2273-4e31-b8f1-52c8ee218ddc tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1321 microversion: 2.1 time: 0.227385 May 26 15:09:27.084399 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 68/122] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:26 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:27.089018 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-9602b2a6-6d92-4380-802a-ecbf4b9f0c61 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:27.089625 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-9602b2a6-6d92-4380-802a-ecbf4b9f0c61 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:27.090965 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7c09968a-0f99-4e04-8fc6-7f384758aa4d tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:27.096493 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9602b2a6-6d92-4380-802a-ecbf4b9f0c61 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:27.096942 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9602b2a6-6d92-4380-802a-ecbf4b9f0c61 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:27.097712 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9602b2a6-6d92-4380-802a-ecbf4b9f0c61 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:27.098156 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9602b2a6-6d92-4380-802a-ecbf4b9f0c61 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:27.099317 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-7c09968a-0f99-4e04-8fc6-7f384758aa4d tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1362 microversion: 2.1 time: 0.213355 May 26 15:09:27.099934 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 55/123] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:26 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:09:27.104474 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-7913e4b3-4e94-45e3-8461-b0d120ada206 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:27.105066 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-7913e4b3-4e94-45e3-8461-b0d120ada206 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:27.106743 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:27.113559 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7913e4b3-4e94-45e3-8461-b0d120ada206 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:27.113938 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7913e4b3-4e94-45e3-8461-b0d120ada206 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:27.114717 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7913e4b3-4e94-45e3-8461-b0d120ada206 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:27.115175 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7913e4b3-4e94-45e3-8461-b0d120ada206 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:27.300915 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-9602b2a6-6d92-4380-802a-ecbf4b9f0c61 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:27.304988 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7913e4b3-4e94-45e3-8461-b0d120ada206 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:27.308906 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-9602b2a6-6d92-4380-802a-ecbf4b9f0c61 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1367 microversion: 2.1 time: 0.223321 May 26 15:09:27.309497 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 69/124] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:27 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:27.314883 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-c9773c24-1b2c-4af7-9435-fc5d7857a5ff tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:27.315754 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-c9773c24-1b2c-4af7-9435-fc5d7857a5ff tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:27.316628 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7913e4b3-4e94-45e3-8461-b0d120ada206 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:27.318232 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7913e4b3-4e94-45e3-8461-b0d120ada206 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:27.319397 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-7913e4b3-4e94-45e3-8461-b0d120ada206 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1406 microversion: 2.20 time: 0.218510 May 26 15:09:27.323119 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 56/125] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:09:27 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1406 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:09:27.323264 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c9773c24-1b2c-4af7-9435-fc5d7857a5ff tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:27.323264 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c9773c24-1b2c-4af7-9435-fc5d7857a5ff tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:27.323430 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c9773c24-1b2c-4af7-9435-fc5d7857a5ff tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:27.323810 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c9773c24-1b2c-4af7-9435-fc5d7857a5ff tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:27.458626 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-c9773c24-1b2c-4af7-9435-fc5d7857a5ff tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a1284bc044e51923c72a9f8f41d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39490fef872043d1bfef791dd0bbb5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:27.466014 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-c9773c24-1b2c-4af7-9435-fc5d7857a5ff tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 200 len: 1314 microversion: 2.1 time: 0.155446 May 26 15:09:27.466573 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 70/126] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:27 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:28.101252 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-07983ece-5ea1-42af-923c-49c5ad00c4c8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:28.101860 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-07983ece-5ea1-42af-923c-49c5ad00c4c8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:28.108353 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-07983ece-5ea1-42af-923c-49c5ad00c4c8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:28.108802 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-07983ece-5ea1-42af-923c-49c5ad00c4c8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:28.109641 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-07983ece-5ea1-42af-923c-49c5ad00c4c8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:28.110151 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-07983ece-5ea1-42af-923c-49c5ad00c4c8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:28.120459 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-08a18de3-8a9c-4d8b-8e5b-46bd24b8b3d8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:28.121106 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-08a18de3-8a9c-4d8b-8e5b-46bd24b8b3d8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:28.127398 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-08a18de3-8a9c-4d8b-8e5b-46bd24b8b3d8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:28.127851 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-08a18de3-8a9c-4d8b-8e5b-46bd24b8b3d8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:28.128620 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-08a18de3-8a9c-4d8b-8e5b-46bd24b8b3d8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:28.129059 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-08a18de3-8a9c-4d8b-8e5b-46bd24b8b3d8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:28.317202 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-07983ece-5ea1-42af-923c-49c5ad00c4c8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:28.320373 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-08a18de3-8a9c-4d8b-8e5b-46bd24b8b3d8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:28.324923 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-07983ece-5ea1-42af-923c-49c5ad00c4c8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1321 microversion: 2.1 time: 0.227803 May 26 15:09:28.325505 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 57/127] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:28 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:28.328759 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-08a18de3-8a9c-4d8b-8e5b-46bd24b8b3d8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1362 microversion: 2.1 time: 0.211441 May 26 15:09:28.329886 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 71/128] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:28 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:09:28.330642 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-3516a625-fd43-401c-8c2b-632a0099d90e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:28.331305 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-3516a625-fd43-401c-8c2b-632a0099d90e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:28.337347 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3516a625-fd43-401c-8c2b-632a0099d90e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:28.337798 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3516a625-fd43-401c-8c2b-632a0099d90e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:28.338560 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3516a625-fd43-401c-8c2b-632a0099d90e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:28.338994 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3516a625-fd43-401c-8c2b-632a0099d90e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:28.341341 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-6aa932d4-cdcf-44e1-b329-185d55a80afe tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:28.342017 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-6aa932d4-cdcf-44e1-b329-185d55a80afe tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:28.348717 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6aa932d4-cdcf-44e1-b329-185d55a80afe tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:28.349171 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6aa932d4-cdcf-44e1-b329-185d55a80afe tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:28.349939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6aa932d4-cdcf-44e1-b329-185d55a80afe tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:28.350420 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6aa932d4-cdcf-44e1-b329-185d55a80afe tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:28.354840 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=100 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:28.541935 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-6aa932d4-cdcf-44e1-b329-185d55a80afe tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:28.545675 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-3516a625-fd43-401c-8c2b-632a0099d90e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:28.550991 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-6aa932d4-cdcf-44e1-b329-185d55a80afe tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:28.552827 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-6aa932d4-cdcf-44e1-b329-185d55a80afe tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:28.553795 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-3516a625-fd43-401c-8c2b-632a0099d90e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1367 microversion: 2.1 time: 0.227322 May 26 15:09:28.554015 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-6aa932d4-cdcf-44e1-b329-185d55a80afe tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1406 microversion: 2.20 time: 0.216833 May 26 15:09:28.554375 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 58/129] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:28 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:28.554623 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 72/130] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:09:28 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:09:28.558745 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1456e491-f9a0-45aa-a752-af1f7d730d58 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:28.559376 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1456e491-f9a0-45aa-a752-af1f7d730d58 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:28.565309 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1456e491-f9a0-45aa-a752-af1f7d730d58 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:28.565759 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1456e491-f9a0-45aa-a752-af1f7d730d58 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:28.566517 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1456e491-f9a0-45aa-a752-af1f7d730d58 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:28.566947 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1456e491-f9a0-45aa-a752-af1f7d730d58 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:28.693479 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1456e491-f9a0-45aa-a752-af1f7d730d58 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a1284bc044e51923c72a9f8f41d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39490fef872043d1bfef791dd0bbb5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:28.700817 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1456e491-f9a0-45aa-a752-af1f7d730d58 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 200 len: 1314 microversion: 2.1 time: 0.145494 May 26 15:09:28.701380 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 59/131] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:28 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:29.342391 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-6c53a5d7-7881-42dd-a0c1-e4debd01f635 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:29.342927 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-6c53a5d7-7881-42dd-a0c1-e4debd01f635 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:29.345014 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:29.346073 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e5d18408-9f33-4289-bda7-936cf523740f tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:29.347131 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e5d18408-9f33-4289-bda7-936cf523740f tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:29.350647 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6c53a5d7-7881-42dd-a0c1-e4debd01f635 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:29.351114 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6c53a5d7-7881-42dd-a0c1-e4debd01f635 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:29.351897 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6c53a5d7-7881-42dd-a0c1-e4debd01f635 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:29.352334 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6c53a5d7-7881-42dd-a0c1-e4debd01f635 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:29.353093 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e5d18408-9f33-4289-bda7-936cf523740f tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:29.353602 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e5d18408-9f33-4289-bda7-936cf523740f tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:29.354411 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e5d18408-9f33-4289-bda7-936cf523740f tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:29.354751 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e5d18408-9f33-4289-bda7-936cf523740f tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:29.550551 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-6c53a5d7-7881-42dd-a0c1-e4debd01f635 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:29.552504 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e5d18408-9f33-4289-bda7-936cf523740f tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:29.554569 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=100 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:29.559065 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-6c53a5d7-7881-42dd-a0c1-e4debd01f635 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1321 microversion: 2.1 time: 0.220527 May 26 15:09:29.560552 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 73/132] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:29 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:29.564024 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e5d18408-9f33-4289-bda7-936cf523740f tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1362 microversion: 2.1 time: 0.222286 May 26 15:09:29.564602 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 60/133] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:29 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:09:29.574365 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-14a90c22-7a4c-4532-bb3c-727ee3f94f94 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:29.578432 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-7da4087c-ba31-4fbe-ac41-c5b0e8369d01 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:29.579127 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-7da4087c-ba31-4fbe-ac41-c5b0e8369d01 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:29.580893 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-14a90c22-7a4c-4532-bb3c-727ee3f94f94 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:29.585565 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7da4087c-ba31-4fbe-ac41-c5b0e8369d01 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:29.586019 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7da4087c-ba31-4fbe-ac41-c5b0e8369d01 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:29.586790 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7da4087c-ba31-4fbe-ac41-c5b0e8369d01 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:29.587259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7da4087c-ba31-4fbe-ac41-c5b0e8369d01 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:29.587617 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-14a90c22-7a4c-4532-bb3c-727ee3f94f94 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:29.588065 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-14a90c22-7a4c-4532-bb3c-727ee3f94f94 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:29.588832 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-14a90c22-7a4c-4532-bb3c-727ee3f94f94 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:29.589265 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-14a90c22-7a4c-4532-bb3c-727ee3f94f94 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:29.782160 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-7da4087c-ba31-4fbe-ac41-c5b0e8369d01 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:29.785150 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-14a90c22-7a4c-4532-bb3c-727ee3f94f94 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:29.789805 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-7da4087c-ba31-4fbe-ac41-c5b0e8369d01 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1367 microversion: 2.1 time: 0.222236 May 26 15:09:29.790573 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 74/134] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:29 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:29.793589 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-14a90c22-7a4c-4532-bb3c-727ee3f94f94 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:29.795173 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-14a90c22-7a4c-4532-bb3c-727ee3f94f94 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:29.796490 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-14a90c22-7a4c-4532-bb3c-727ee3f94f94 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1406 microversion: 2.20 time: 0.226062 May 26 15:09:29.799147 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 61/135] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:09:29 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1406 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:09:29.804479 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-61cac77f-6f99-417a-9063-c087200ace67 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:29.805086 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-61cac77f-6f99-417a-9063-c087200ace67 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:29.811056 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-61cac77f-6f99-417a-9063-c087200ace67 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:29.811533 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-61cac77f-6f99-417a-9063-c087200ace67 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:29.812298 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-61cac77f-6f99-417a-9063-c087200ace67 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:29.812735 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-61cac77f-6f99-417a-9063-c087200ace67 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:29.944175 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-61cac77f-6f99-417a-9063-c087200ace67 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a1284bc044e51923c72a9f8f41d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39490fef872043d1bfef791dd0bbb5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:29.951423 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-61cac77f-6f99-417a-9063-c087200ace67 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 200 len: 1314 microversion: 2.1 time: 0.150522 May 26 15:09:29.951916 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 75/136] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:29 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:30.584173 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-70769f6a-da75-4ac5-b280-4d8b015de810 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:30.584937 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-70769f6a-da75-4ac5-b280-4d8b015de810 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:30.586993 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-0ed9c1b0-8db6-464d-a435-3369ac67cc1d tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:30.586993 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-0ed9c1b0-8db6-464d-a435-3369ac67cc1d tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:30.591585 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=8 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:30.593341 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-70769f6a-da75-4ac5-b280-4d8b015de810 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:30.593772 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0ed9c1b0-8db6-464d-a435-3369ac67cc1d tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:30.594339 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-70769f6a-da75-4ac5-b280-4d8b015de810 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:30.594613 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0ed9c1b0-8db6-464d-a435-3369ac67cc1d tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:30.594940 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-70769f6a-da75-4ac5-b280-4d8b015de810 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:30.595357 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0ed9c1b0-8db6-464d-a435-3369ac67cc1d tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:30.595472 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-70769f6a-da75-4ac5-b280-4d8b015de810 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:30.596040 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0ed9c1b0-8db6-464d-a435-3369ac67cc1d tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:30.821763 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-0ed9c1b0-8db6-464d-a435-3369ac67cc1d tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:30.823387 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-70769f6a-da75-4ac5-b280-4d8b015de810 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:30.835798 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-0ed9c1b0-8db6-464d-a435-3369ac67cc1d tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1321 microversion: 2.1 time: 0.253600 May 26 15:09:30.836509 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-70769f6a-da75-4ac5-b280-4d8b015de810 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1362 microversion: 2.1 time: 0.256088 May 26 15:09:30.836977 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 76/137] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:30 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1321 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:30.849397 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-cf129717-5b40-4f17-9c43-332c406b1272 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:30.850877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-cf129717-5b40-4f17-9c43-332c406b1272 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:30.852402 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 62/138] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:30 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1362 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:09:30.862855 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-cf129717-5b40-4f17-9c43-332c406b1272 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:30.863993 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-cf129717-5b40-4f17-9c43-332c406b1272 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:30.865441 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-cf129717-5b40-4f17-9c43-332c406b1272 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:30.866133 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-cf129717-5b40-4f17-9c43-332c406b1272 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:30.866726 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-72c20937-2476-4e28-9fc6-50b83804d73a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:30.868400 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-72c20937-2476-4e28-9fc6-50b83804d73a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:30.879205 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-72c20937-2476-4e28-9fc6-50b83804d73a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:30.879886 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-72c20937-2476-4e28-9fc6-50b83804d73a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:30.881123 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-72c20937-2476-4e28-9fc6-50b83804d73a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:30.881709 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-72c20937-2476-4e28-9fc6-50b83804d73a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:31.103175 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-cf129717-5b40-4f17-9c43-332c406b1272 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:31.103307 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-72c20937-2476-4e28-9fc6-50b83804d73a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:31.103453 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-cf129717-5b40-4f17-9c43-332c406b1272 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1367 microversion: 2.1 time: 0.263502 May 26 15:09:31.103453 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 77/139] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:30 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:31.104450 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-72c20937-2476-4e28-9fc6-50b83804d73a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:31.106325 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-72c20937-2476-4e28-9fc6-50b83804d73a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:31.108191 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-72c20937-2476-4e28-9fc6-50b83804d73a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1406 microversion: 2.20 time: 0.251220 May 26 15:09:31.108862 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 63/140] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:09:30 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1406 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:09:31.114503 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-266e3269-34ad-4455-87f3-4c566f5fce9a tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:31.115139 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-266e3269-34ad-4455-87f3-4c566f5fce9a tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:31.121590 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-266e3269-34ad-4455-87f3-4c566f5fce9a tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:31.122040 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-266e3269-34ad-4455-87f3-4c566f5fce9a tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:31.122804 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-266e3269-34ad-4455-87f3-4c566f5fce9a tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:31.123289 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-266e3269-34ad-4455-87f3-4c566f5fce9a tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:31.263579 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-266e3269-34ad-4455-87f3-4c566f5fce9a tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a1284bc044e51923c72a9f8f41d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39490fef872043d1bfef791dd0bbb5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:31.274481 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-266e3269-34ad-4455-87f3-4c566f5fce9a tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 200 len: 1314 microversion: 2.1 time: 0.169902 May 26 15:09:31.275265 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 78/141] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:31 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:31.853109 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1810bc85-6abe-40d8-b4ad-3b043899a7a2 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:31.853859 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1810bc85-6abe-40d8-b4ad-3b043899a7a2 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:31.863549 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1810bc85-6abe-40d8-b4ad-3b043899a7a2 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:31.864000 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1810bc85-6abe-40d8-b4ad-3b043899a7a2 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:31.865639 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1810bc85-6abe-40d8-b4ad-3b043899a7a2 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:31.866288 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1810bc85-6abe-40d8-b4ad-3b043899a7a2 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:31.867277 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-b3699d74-04ff-42c4-9fef-01a8275c1953 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:31.867989 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-b3699d74-04ff-42c4-9fef-01a8275c1953 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:31.874614 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b3699d74-04ff-42c4-9fef-01a8275c1953 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:31.875361 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b3699d74-04ff-42c4-9fef-01a8275c1953 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:31.876319 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b3699d74-04ff-42c4-9fef-01a8275c1953 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:31.877727 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b3699d74-04ff-42c4-9fef-01a8275c1953 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:32.189942 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1810bc85-6abe-40d8-b4ad-3b043899a7a2 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:32.203951 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1810bc85-6abe-40d8-b4ad-3b043899a7a2 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1321 microversion: 2.1 time: 0.354665 May 26 15:09:32.206641 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 64/142] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:31 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1321 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:32.213780 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-229221c0-3070-480b-a0f7-80b65cdd4394 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:32.214591 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-229221c0-3070-480b-a0f7-80b65cdd4394 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:32.225313 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-229221c0-3070-480b-a0f7-80b65cdd4394 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:32.225945 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-229221c0-3070-480b-a0f7-80b65cdd4394 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:32.227203 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-229221c0-3070-480b-a0f7-80b65cdd4394 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:32.228076 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-229221c0-3070-480b-a0f7-80b65cdd4394 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:32.235647 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-b3699d74-04ff-42c4-9fef-01a8275c1953 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:32.249145 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-b3699d74-04ff-42c4-9fef-01a8275c1953 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1362 microversion: 2.1 time: 0.381707 May 26 15:09:32.250837 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 79/143] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:31 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1362 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:32.255622 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-b3c850a2-5201-4f35-ba2a-19a30cd2b652 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:32.256222 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-b3c850a2-5201-4f35-ba2a-19a30cd2b652 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:32.269669 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b3c850a2-5201-4f35-ba2a-19a30cd2b652 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:32.270478 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b3c850a2-5201-4f35-ba2a-19a30cd2b652 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:32.272010 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b3c850a2-5201-4f35-ba2a-19a30cd2b652 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:32.272657 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b3c850a2-5201-4f35-ba2a-19a30cd2b652 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:32.508009 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-229221c0-3070-480b-a0f7-80b65cdd4394 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:32.525565 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-229221c0-3070-480b-a0f7-80b65cdd4394 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1367 microversion: 2.1 time: 0.316968 May 26 15:09:32.527606 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 65/144] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:32 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1367 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:32.532535 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-b3c850a2-5201-4f35-ba2a-19a30cd2b652 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:32.535318 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-5bfb4816-f89f-48ce-bfd4-2a1456c09d93 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:32.536885 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-5bfb4816-f89f-48ce-bfd4-2a1456c09d93 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:32.540776 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-b3c850a2-5201-4f35-ba2a-19a30cd2b652 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:32.548145 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-b3c850a2-5201-4f35-ba2a-19a30cd2b652 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:32.548543 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5bfb4816-f89f-48ce-bfd4-2a1456c09d93 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:32.549286 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-b3c850a2-5201-4f35-ba2a-19a30cd2b652 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1406 microversion: 2.20 time: 0.297287 May 26 15:09:32.549653 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5bfb4816-f89f-48ce-bfd4-2a1456c09d93 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:32.550162 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 80/145] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:09:32 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1406 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:09:32.551105 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5bfb4816-f89f-48ce-bfd4-2a1456c09d93 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:32.551626 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5bfb4816-f89f-48ce-bfd4-2a1456c09d93 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:32.717935 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-5bfb4816-f89f-48ce-bfd4-2a1456c09d93 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a1284bc044e51923c72a9f8f41d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39490fef872043d1bfef791dd0bbb5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:32.731377 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-5bfb4816-f89f-48ce-bfd4-2a1456c09d93 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 200 len: 1314 microversion: 2.1 time: 0.201975 May 26 15:09:32.741168 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 66/146] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:32 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:33.222192 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-103379c3-7d53-4f84-b1e7-7d2bc056159a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:33.222782 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-103379c3-7d53-4f84-b1e7-7d2bc056159a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:33.231768 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-103379c3-7d53-4f84-b1e7-7d2bc056159a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:33.241329 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-103379c3-7d53-4f84-b1e7-7d2bc056159a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:33.243588 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-103379c3-7d53-4f84-b1e7-7d2bc056159a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:33.244653 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-103379c3-7d53-4f84-b1e7-7d2bc056159a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:33.267293 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ec37b694-f45d-4768-9e83-7d76ee18d2ae tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:33.267901 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ec37b694-f45d-4768-9e83-7d76ee18d2ae tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:33.281833 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ec37b694-f45d-4768-9e83-7d76ee18d2ae tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:33.283839 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ec37b694-f45d-4768-9e83-7d76ee18d2ae tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:33.286264 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ec37b694-f45d-4768-9e83-7d76ee18d2ae tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:33.286885 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ec37b694-f45d-4768-9e83-7d76ee18d2ae tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:33.772037 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-103379c3-7d53-4f84-b1e7-7d2bc056159a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:33.775892 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ec37b694-f45d-4768-9e83-7d76ee18d2ae tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:33.790557 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ec37b694-f45d-4768-9e83-7d76ee18d2ae tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1362 microversion: 2.1 time: 0.527244 May 26 15:09:33.793398 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 67/147] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:33 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1362 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:09:33.796038 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-103379c3-7d53-4f84-b1e7-7d2bc056159a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1321 microversion: 2.1 time: 0.577968 May 26 15:09:33.799129 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 81/148] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:33 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1321 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:33.805916 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-f87b6d15-0f1f-4bbd-b1d4-a4426a7e4e7d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:33.806727 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-f87b6d15-0f1f-4bbd-b1d4-a4426a7e4e7d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:33.818280 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-2048240a-b05f-453d-93af-1a8e461ca62a tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:33.819028 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f87b6d15-0f1f-4bbd-b1d4-a4426a7e4e7d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:33.820027 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f87b6d15-0f1f-4bbd-b1d4-a4426a7e4e7d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:33.822072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f87b6d15-0f1f-4bbd-b1d4-a4426a7e4e7d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:33.822662 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f87b6d15-0f1f-4bbd-b1d4-a4426a7e4e7d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:33.824429 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-2048240a-b05f-453d-93af-1a8e461ca62a tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:33.842322 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2048240a-b05f-453d-93af-1a8e461ca62a tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:33.842797 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2048240a-b05f-453d-93af-1a8e461ca62a tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:33.843962 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2048240a-b05f-453d-93af-1a8e461ca62a tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:33.844402 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2048240a-b05f-453d-93af-1a8e461ca62a tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:34.128220 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-f87b6d15-0f1f-4bbd-b1d4-a4426a7e4e7d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:34.137318 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-f87b6d15-0f1f-4bbd-b1d4-a4426a7e4e7d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:34.139513 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-f87b6d15-0f1f-4bbd-b1d4-a4426a7e4e7d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:34.141406 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-f87b6d15-0f1f-4bbd-b1d4-a4426a7e4e7d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1406 microversion: 2.20 time: 0.342634 May 26 15:09:34.142105 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 82/149] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:09:33 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1406 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:09:34.150325 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-c2cecaf9-b26a-4b02-9ff9-a2c57586dfa6 req-c85fb35a-19c8-4486-8588-5644a2eb948d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f969f1fa-bb13-4b63-9095-0881db5202df", "tag": "e5676082-5402-41ae-be68-6d928c3d3d18"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:34.179822 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2048240a-b05f-453d-93af-1a8e461ca62a tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:34.191227 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-2048240a-b05f-453d-93af-1a8e461ca62a tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1367 microversion: 2.1 time: 0.394024 May 26 15:09:34.191400 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-c2cecaf9-b26a-4b02-9ff9-a2c57586dfa6 req-c85fb35a-19c8-4486-8588-5644a2eb948d service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:34.192048 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-c2cecaf9-b26a-4b02-9ff9-a2c57586dfa6 req-c85fb35a-19c8-4486-8588-5644a2eb948d service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:34.192332 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 68/150] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:33 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1367 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:34.197695 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-75d72fd6-5206-481a-aa2b-313a47c16cbe tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:34.198302 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-75d72fd6-5206-481a-aa2b-313a47c16cbe tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:34.205986 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-75d72fd6-5206-481a-aa2b-313a47c16cbe tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:34.206438 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-75d72fd6-5206-481a-aa2b-313a47c16cbe tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:34.207259 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-75d72fd6-5206-481a-aa2b-313a47c16cbe tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:34.207688 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-75d72fd6-5206-481a-aa2b-313a47c16cbe tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:34.229814 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-c2cecaf9-b26a-4b02-9ff9-a2c57586dfa6 req-c85fb35a-19c8-4486-8588-5644a2eb948d service nova] Creating event network-changed:e5676082-5402-41ae-be68-6d928c3d3d18 for instance f969f1fa-bb13-4b63-9095-0881db5202df on hv-cinder-84301 May 26 15:09:34.243658 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-c2cecaf9-b26a-4b02-9ff9-a2c57586dfa6 req-c85fb35a-19c8-4486-8588-5644a2eb948d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099974 May 26 15:09:34.244645 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 83/151] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:09:34.367932 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-75d72fd6-5206-481a-aa2b-313a47c16cbe tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a1284bc044e51923c72a9f8f41d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39490fef872043d1bfef791dd0bbb5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:34.380666 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-75d72fd6-5206-481a-aa2b-313a47c16cbe tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 200 len: 1314 microversion: 2.1 time: 0.186671 May 26 15:09:34.381432 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 69/152] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:34 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:34.814131 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-d26477a1-1e87-40cf-9184-d72b12adc33b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:34.815605 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-d26477a1-1e87-40cf-9184-d72b12adc33b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:34.817728 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b541cb17-0654-4014-a7ab-0053d5935e9c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:34.818673 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b541cb17-0654-4014-a7ab-0053d5935e9c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:34.827503 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d26477a1-1e87-40cf-9184-d72b12adc33b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:34.828565 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d26477a1-1e87-40cf-9184-d72b12adc33b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:34.829668 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d26477a1-1e87-40cf-9184-d72b12adc33b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:34.830412 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d26477a1-1e87-40cf-9184-d72b12adc33b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:34.830984 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b541cb17-0654-4014-a7ab-0053d5935e9c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:34.831524 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b541cb17-0654-4014-a7ab-0053d5935e9c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:34.832777 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b541cb17-0654-4014-a7ab-0053d5935e9c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:34.834731 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b541cb17-0654-4014-a7ab-0053d5935e9c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:35.064519 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b541cb17-0654-4014-a7ab-0053d5935e9c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:35.077306 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b541cb17-0654-4014-a7ab-0053d5935e9c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1321 microversion: 2.1 time: 0.267526 May 26 15:09:35.078879 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 70/153] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:34 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1321 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:35.105983 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-d26477a1-1e87-40cf-9184-d72b12adc33b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:35.118664 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-d26477a1-1e87-40cf-9184-d72b12adc33b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1362 microversion: 2.1 time: 0.312851 May 26 15:09:35.119954 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 84/154] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:34 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1362 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:35.164260 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a8e51b0b-a76d-4461-9c5c-008a706f3797 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:35.166591 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a8e51b0b-a76d-4461-9c5c-008a706f3797 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:35.188030 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a8e51b0b-a76d-4461-9c5c-008a706f3797 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:35.188779 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a8e51b0b-a76d-4461-9c5c-008a706f3797 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:35.192515 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a8e51b0b-a76d-4461-9c5c-008a706f3797 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:35.193171 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a8e51b0b-a76d-4461-9c5c-008a706f3797 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:35.211017 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-eb9ce026-08ec-43cb-a9d3-b25aa11e5672 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:35.211774 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-eb9ce026-08ec-43cb-a9d3-b25aa11e5672 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:35.227436 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-eb9ce026-08ec-43cb-a9d3-b25aa11e5672 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:35.229105 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-eb9ce026-08ec-43cb-a9d3-b25aa11e5672 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:35.231518 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-eb9ce026-08ec-43cb-a9d3-b25aa11e5672 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:35.232136 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-eb9ce026-08ec-43cb-a9d3-b25aa11e5672 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:35.798042 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-eb9ce026-08ec-43cb-a9d3-b25aa11e5672 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:35.810056 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-eb9ce026-08ec-43cb-a9d3-b25aa11e5672 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1367 microversion: 2.1 time: 0.604622 May 26 15:09:35.811684 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 85/155] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:35 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1367 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:35.814343 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a8e51b0b-a76d-4461-9c5c-008a706f3797 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:35.819843 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-07d86483-bf53-471c-af34-638d2dee75fe tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:35.821792 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-07d86483-bf53-471c-af34-638d2dee75fe tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:35.825527 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a8e51b0b-a76d-4461-9c5c-008a706f3797 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:35.827032 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a8e51b0b-a76d-4461-9c5c-008a706f3797 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:35.828763 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a8e51b0b-a76d-4461-9c5c-008a706f3797 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1406 microversion: 2.20 time: 0.672578 May 26 15:09:35.829326 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 71/156] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:09:35 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1406 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:09:35.831543 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-07d86483-bf53-471c-af34-638d2dee75fe tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:35.832328 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-07d86483-bf53-471c-af34-638d2dee75fe tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:35.833630 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-07d86483-bf53-471c-af34-638d2dee75fe tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:35.833738 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-a4c0dbbb-2d88-40f3-b321-b20f0d2bbade req-58d72e6f-3f47-4777-bf33-aeb5ff2dae67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab471a8e-c724-4c71-b9ce-b253771d23a1", "name": "network-vif-plugged", "status": "completed", "tag": "fb04c6b8-9901-4e4f-acc2-c4c580e85f3e"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:35.834368 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-07d86483-bf53-471c-af34-638d2dee75fe tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:35.885848 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-a4c0dbbb-2d88-40f3-b321-b20f0d2bbade req-58d72e6f-3f47-4777-bf33-aeb5ff2dae67 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:35.895581 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-a4c0dbbb-2d88-40f3-b321-b20f0d2bbade req-58d72e6f-3f47-4777-bf33-aeb5ff2dae67 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:35.926042 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-a4c0dbbb-2d88-40f3-b321-b20f0d2bbade req-58d72e6f-3f47-4777-bf33-aeb5ff2dae67 service nova] Creating event network-vif-plugged:fb04c6b8-9901-4e4f-acc2-c4c580e85f3e for instance ab471a8e-c724-4c71-b9ce-b253771d23a1 on hv-cinder-84301 May 26 15:09:35.938759 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-a4c0dbbb-2d88-40f3-b321-b20f0d2bbade req-58d72e6f-3f47-4777-bf33-aeb5ff2dae67 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107637 May 26 15:09:35.942378 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 72/157] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:09:36.097538 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-0afb2fd0-797d-40b7-8169-cc6195a8bd15 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:36.098227 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-0afb2fd0-797d-40b7-8169-cc6195a8bd15 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:36.114840 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0afb2fd0-797d-40b7-8169-cc6195a8bd15 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:36.115372 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0afb2fd0-797d-40b7-8169-cc6195a8bd15 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:36.123680 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0afb2fd0-797d-40b7-8169-cc6195a8bd15 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:36.126482 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0afb2fd0-797d-40b7-8169-cc6195a8bd15 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:36.834045 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-07d86483-bf53-471c-af34-638d2dee75fe tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a1284bc044e51923c72a9f8f41d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39490fef872043d1bfef791dd0bbb5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:36.853396 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-07d86483-bf53-471c-af34-638d2dee75fe tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 200 len: 1314 microversion: 2.1 time: 1.039472 May 26 15:09:36.858296 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 86/158] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:35 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 1314 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:36.875353 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-8d6ba570-a1a2-4473-9d69-c7e955a6a698 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:36.877823 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-8d6ba570-a1a2-4473-9d69-c7e955a6a698 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:36.894546 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8d6ba570-a1a2-4473-9d69-c7e955a6a698 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:36.896422 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8d6ba570-a1a2-4473-9d69-c7e955a6a698 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:36.900216 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8d6ba570-a1a2-4473-9d69-c7e955a6a698 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:36.903860 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8d6ba570-a1a2-4473-9d69-c7e955a6a698 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:36.933879 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-0afb2fd0-797d-40b7-8169-cc6195a8bd15 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:36.949256 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-0afb2fd0-797d-40b7-8169-cc6195a8bd15 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1321 microversion: 2.1 time: 0.857061 May 26 15:09:36.992105 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 73/159] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:36 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1321 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:09:37.026921 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-62280e6c-81aa-4acf-9ed4-b92410ed4f27 req-8d789e38-2366-42d0-86d9-96b187ba9232 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6", "tag": "6342ec5c-6f4f-42ae-aaeb-2f79c05fef02"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:37.056477 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-62280e6c-81aa-4acf-9ed4-b92410ed4f27 req-8d789e38-2366-42d0-86d9-96b187ba9232 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:37.057398 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-62280e6c-81aa-4acf-9ed4-b92410ed4f27 req-8d789e38-2366-42d0-86d9-96b187ba9232 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:37.075433 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-62280e6c-81aa-4acf-9ed4-b92410ed4f27 req-8d789e38-2366-42d0-86d9-96b187ba9232 service nova] Creating event network-changed:6342ec5c-6f4f-42ae-aaeb-2f79c05fef02 for instance 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 on hv-cinder-84301 May 26 15:09:37.084178 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-62280e6c-81aa-4acf-9ed4-b92410ed4f27 req-8d789e38-2366-42d0-86d9-96b187ba9232 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085602 May 26 15:09:37.085284 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 74/160] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:09:37.098220 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-5921a7e9-1f41-445f-b149-535d19002b97 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:37.100568 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-5921a7e9-1f41-445f-b149-535d19002b97 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:37.115340 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5921a7e9-1f41-445f-b149-535d19002b97 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:37.116188 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5921a7e9-1f41-445f-b149-535d19002b97 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:37.117209 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5921a7e9-1f41-445f-b149-535d19002b97 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:37.117946 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5921a7e9-1f41-445f-b149-535d19002b97 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:37.613706 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-8d6ba570-a1a2-4473-9d69-c7e955a6a698 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:37.622515 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-8d6ba570-a1a2-4473-9d69-c7e955a6a698 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1362 microversion: 2.1 time: 0.759004 May 26 15:09:37.630760 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 87/161] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:36 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1362 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:37.637037 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-6963047f-71a8-4aa6-ac5e-19255daa3a3d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:37.642603 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-6963047f-71a8-4aa6-ac5e-19255daa3a3d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:37.660588 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6963047f-71a8-4aa6-ac5e-19255daa3a3d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:37.661152 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6963047f-71a8-4aa6-ac5e-19255daa3a3d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:37.664280 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6963047f-71a8-4aa6-ac5e-19255daa3a3d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:37.665045 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6963047f-71a8-4aa6-ac5e-19255daa3a3d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:37.682716 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-5921a7e9-1f41-445f-b149-535d19002b97 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:37.706256 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-5921a7e9-1f41-445f-b149-535d19002b97 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1367 microversion: 2.1 time: 0.616974 May 26 15:09:37.707866 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 75/162] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:37 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1367 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:37.852781 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-6963047f-71a8-4aa6-ac5e-19255daa3a3d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:37.862872 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-6963047f-71a8-4aa6-ac5e-19255daa3a3d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:37.864421 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-6963047f-71a8-4aa6-ac5e-19255daa3a3d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:37.865797 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-6963047f-71a8-4aa6-ac5e-19255daa3a3d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1406 microversion: 2.20 time: 0.233532 May 26 15:09:37.866826 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 88/163] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:09:37 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:09:37.877598 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-0991208e-cd0e-4b39-b0e7-5790def6e153 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:37.881320 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-0991208e-cd0e-4b39-b0e7-5790def6e153 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:37.887034 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0991208e-cd0e-4b39-b0e7-5790def6e153 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:37.887547 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0991208e-cd0e-4b39-b0e7-5790def6e153 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:37.888311 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0991208e-cd0e-4b39-b0e7-5790def6e153 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:37.888739 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0991208e-cd0e-4b39-b0e7-5790def6e153 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:37.963548 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-b07b2867-6f78-4e6b-bd51-8493be5f830c req-deb35a19-0269-40f6-bf93-4d207adf09d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44b285a0-afad-471d-8d28-7e8972acca1a", "name": "network-vif-plugged", "status": "completed", "tag": "c2e407fa-92ac-42e8-af38-3255afe28425"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:37.978249 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-b07b2867-6f78-4e6b-bd51-8493be5f830c req-deb35a19-0269-40f6-bf93-4d207adf09d2 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:37.978868 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-b07b2867-6f78-4e6b-bd51-8493be5f830c req-deb35a19-0269-40f6-bf93-4d207adf09d2 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:38.003890 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-b07b2867-6f78-4e6b-bd51-8493be5f830c req-deb35a19-0269-40f6-bf93-4d207adf09d2 service nova] Creating event network-vif-plugged:c2e407fa-92ac-42e8-af38-3255afe28425 for instance 44b285a0-afad-471d-8d28-7e8972acca1a on hv-cinder-84301 May 26 15:09:38.012340 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-b07b2867-6f78-4e6b-bd51-8493be5f830c req-deb35a19-0269-40f6-bf93-4d207adf09d2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054901 May 26 15:09:38.013511 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 89/164] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:09:38.019575 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-73f8faf4-de7d-44f1-8af8-619b2096f46a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:38.020249 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-73f8faf4-de7d-44f1-8af8-619b2096f46a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:38.028958 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-73f8faf4-de7d-44f1-8af8-619b2096f46a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:38.029970 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-73f8faf4-de7d-44f1-8af8-619b2096f46a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:38.032308 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-73f8faf4-de7d-44f1-8af8-619b2096f46a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:38.033470 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-73f8faf4-de7d-44f1-8af8-619b2096f46a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:38.062032 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=100 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:38.083332 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-0991208e-cd0e-4b39-b0e7-5790def6e153 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a1284bc044e51923c72a9f8f41d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39490fef872043d1bfef791dd0bbb5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:38.097029 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-0991208e-cd0e-4b39-b0e7-5790def6e153 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 200 len: 1500 microversion: 2.1 time: 0.228414 May 26 15:09:38.098226 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 76/165] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:37 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 1500 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:38.512394 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-73f8faf4-de7d-44f1-8af8-619b2096f46a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:38.524507 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-73f8faf4-de7d-44f1-8af8-619b2096f46a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1321 microversion: 2.1 time: 0.509259 May 26 15:09:38.528721 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 90/166] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:38 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1321 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:38.654736 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-dc18a49f-c154-4fc2-95a5-e519b8cdc5b5 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:38.655781 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-dc18a49f-c154-4fc2-95a5-e519b8cdc5b5 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:38.670495 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dc18a49f-c154-4fc2-95a5-e519b8cdc5b5 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:38.675882 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dc18a49f-c154-4fc2-95a5-e519b8cdc5b5 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:38.676723 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dc18a49f-c154-4fc2-95a5-e519b8cdc5b5 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:38.680620 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dc18a49f-c154-4fc2-95a5-e519b8cdc5b5 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:38.725530 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-8637a8fb-ad30-407a-9110-e64f495672bf tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:38.726883 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-8637a8fb-ad30-407a-9110-e64f495672bf tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:38.734080 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8637a8fb-ad30-407a-9110-e64f495672bf tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:38.734637 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8637a8fb-ad30-407a-9110-e64f495672bf tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:38.735331 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8637a8fb-ad30-407a-9110-e64f495672bf tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:38.735781 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8637a8fb-ad30-407a-9110-e64f495672bf tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:38.919571 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-dc18a49f-c154-4fc2-95a5-e519b8cdc5b5 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:38.931121 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-dc18a49f-c154-4fc2-95a5-e519b8cdc5b5 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1362 microversion: 2.1 time: 0.285633 May 26 15:09:38.932660 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 77/167] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:38 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1362 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:38.947255 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-30e16042-0064-47a4-b139-9f4a520dc95d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:38.947877 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-30e16042-0064-47a4-b139-9f4a520dc95d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:38.965145 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-30e16042-0064-47a4-b139-9f4a520dc95d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:38.966090 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-30e16042-0064-47a4-b139-9f4a520dc95d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:38.968433 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-30e16042-0064-47a4-b139-9f4a520dc95d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:38.969136 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-30e16042-0064-47a4-b139-9f4a520dc95d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:39.129176 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-8637a8fb-ad30-407a-9110-e64f495672bf tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:39.143904 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-8637a8fb-ad30-407a-9110-e64f495672bf tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1367 microversion: 2.1 time: 0.419647 May 26 15:09:39.148984 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 91/168] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:38 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1367 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:39.224992 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-30e16042-0064-47a4-b139-9f4a520dc95d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:39.231309 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=100 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:39.235440 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-30e16042-0064-47a4-b139-9f4a520dc95d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:39.237302 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-30e16042-0064-47a4-b139-9f4a520dc95d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:39.238712 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-30e16042-0064-47a4-b139-9f4a520dc95d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1406 microversion: 2.20 time: 0.304767 May 26 15:09:39.239685 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 78/169] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:09:38 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1406 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:09:39.546595 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-ca772751-24ae-461f-b182-309d94cd89f3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:39.550463 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-ca772751-24ae-461f-b182-309d94cd89f3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:39.554928 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ca772751-24ae-461f-b182-309d94cd89f3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:39.555506 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ca772751-24ae-461f-b182-309d94cd89f3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:39.556340 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ca772751-24ae-461f-b182-309d94cd89f3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:39.556771 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ca772751-24ae-461f-b182-309d94cd89f3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:39.698482 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-ca772751-24ae-461f-b182-309d94cd89f3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:39.709887 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-ca772751-24ae-461f-b182-309d94cd89f3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1321 microversion: 2.1 time: 0.167437 May 26 15:09:39.710786 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 92/170] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:39 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:39.835584 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-fb93547c-1474-4139-a9c9-5460882f586a tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5da83035-c742-413c-a12e-fcc54b5cc8c8"}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:39.836739 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-fb93547c-1474-4139-a9c9-5460882f586a tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:39.844158 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fb93547c-1474-4139-a9c9-5460882f586a tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:39.844870 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fb93547c-1474-4139-a9c9-5460882f586a tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:39.845865 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fb93547c-1474-4139-a9c9-5460882f586a tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:39.846504 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fb93547c-1474-4139-a9c9-5460882f586a tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:39.948749 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-6bfcc540-0b4f-4949-b292-926cfc557be2 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:39.949590 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-6bfcc540-0b4f-4949-b292-926cfc557be2 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:39.957480 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6bfcc540-0b4f-4949-b292-926cfc557be2 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:39.958429 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6bfcc540-0b4f-4949-b292-926cfc557be2 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:39.959450 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6bfcc540-0b4f-4949-b292-926cfc557be2 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:39.960190 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6bfcc540-0b4f-4949-b292-926cfc557be2 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:40.165921 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-6bfcc540-0b4f-4949-b292-926cfc557be2 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:40.176124 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-6bfcc540-0b4f-4949-b292-926cfc557be2 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1362 microversion: 2.1 time: 0.230962 May 26 15:09:40.176726 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 93/171] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:39 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:40.185718 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-dfc14e8f-3167-476a-94c8-5ea2bcefe485 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:40.185718 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-dfc14e8f-3167-476a-94c8-5ea2bcefe485 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:40.201115 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dfc14e8f-3167-476a-94c8-5ea2bcefe485 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:40.201564 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dfc14e8f-3167-476a-94c8-5ea2bcefe485 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:40.202408 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dfc14e8f-3167-476a-94c8-5ea2bcefe485 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:40.202850 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dfc14e8f-3167-476a-94c8-5ea2bcefe485 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:40.373079 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-dfc14e8f-3167-476a-94c8-5ea2bcefe485 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:40.386575 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-dfc14e8f-3167-476a-94c8-5ea2bcefe485 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1367 microversion: 2.1 time: 0.208566 May 26 15:09:40.387489 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 94/172] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:40 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:40.395567 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-1b13bc0c-c0cb-4fb2-93ff-0c041cf5358e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:40.396563 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-1b13bc0c-c0cb-4fb2-93ff-0c041cf5358e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:40.407451 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1b13bc0c-c0cb-4fb2-93ff-0c041cf5358e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:40.407960 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1b13bc0c-c0cb-4fb2-93ff-0c041cf5358e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:40.408669 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1b13bc0c-c0cb-4fb2-93ff-0c041cf5358e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:40.409268 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1b13bc0c-c0cb-4fb2-93ff-0c041cf5358e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:40.562905 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-1b13bc0c-c0cb-4fb2-93ff-0c041cf5358e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:40.571715 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-1b13bc0c-c0cb-4fb2-93ff-0c041cf5358e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:40.573223 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-1b13bc0c-c0cb-4fb2-93ff-0c041cf5358e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:40.574454 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-1b13bc0c-c0cb-4fb2-93ff-0c041cf5358e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1406 microversion: 2.20 time: 0.185790 May 26 15:09:40.575596 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 95/173] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:09:40 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:09:40.727323 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-56ab9adb-9bc4-4e5d-bea5-c639c4a4bbe6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:40.729775 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-56ab9adb-9bc4-4e5d-bea5-c639c4a4bbe6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:40.738276 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-56ab9adb-9bc4-4e5d-bea5-c639c4a4bbe6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:40.739076 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-56ab9adb-9bc4-4e5d-bea5-c639c4a4bbe6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:40.739902 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-56ab9adb-9bc4-4e5d-bea5-c639c4a4bbe6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:40.740566 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-56ab9adb-9bc4-4e5d-bea5-c639c4a4bbe6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:40.922300 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-56ab9adb-9bc4-4e5d-bea5-c639c4a4bbe6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:40.930426 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-56ab9adb-9bc4-4e5d-bea5-c639c4a4bbe6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1321 microversion: 2.1 time: 0.207400 May 26 15:09:40.931003 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 96/174] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:40 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:09:41.194799 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-1380f9ab-23be-4697-9068-ecab8a56c405 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:41.196279 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-1380f9ab-23be-4697-9068-ecab8a56c405 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:41.203389 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1380f9ab-23be-4697-9068-ecab8a56c405 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:41.204221 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1380f9ab-23be-4697-9068-ecab8a56c405 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:41.205520 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1380f9ab-23be-4697-9068-ecab8a56c405 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:41.205904 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1380f9ab-23be-4697-9068-ecab8a56c405 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:41.393965 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-1380f9ab-23be-4697-9068-ecab8a56c405 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:41.406909 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-1380f9ab-23be-4697-9068-ecab8a56c405 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1362 microversion: 2.1 time: 0.216247 May 26 15:09:41.415939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 97/175] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:41 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1362 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:41.420780 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-0b7b3665-e519-4b32-aa94-3f5598b99ec3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:41.421780 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-0b7b3665-e519-4b32-aa94-3f5598b99ec3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:41.428109 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0b7b3665-e519-4b32-aa94-3f5598b99ec3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:41.428848 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0b7b3665-e519-4b32-aa94-3f5598b99ec3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:41.430160 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0b7b3665-e519-4b32-aa94-3f5598b99ec3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:41.430603 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0b7b3665-e519-4b32-aa94-3f5598b99ec3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:41.619032 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-0b7b3665-e519-4b32-aa94-3f5598b99ec3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:41.628211 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-0b7b3665-e519-4b32-aa94-3f5598b99ec3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1367 microversion: 2.1 time: 0.211058 May 26 15:09:41.629138 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 98/176] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:41 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:41.636237 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-48961743-dacd-4873-b618-9638c5b60f3d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:41.637067 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-48961743-dacd-4873-b618-9638c5b60f3d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:41.645619 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-48961743-dacd-4873-b618-9638c5b60f3d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:41.646089 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-48961743-dacd-4873-b618-9638c5b60f3d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:41.646874 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-48961743-dacd-4873-b618-9638c5b60f3d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:41.647493 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-48961743-dacd-4873-b618-9638c5b60f3d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:41.919515 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-48961743-dacd-4873-b618-9638c5b60f3d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:41.928876 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-48961743-dacd-4873-b618-9638c5b60f3d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:41.930415 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-48961743-dacd-4873-b618-9638c5b60f3d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:41.931593 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-48961743-dacd-4873-b618-9638c5b60f3d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1406 microversion: 2.20 time: 0.301363 May 26 15:09:41.932154 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 99/177] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:09:41 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1406 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:09:41.947463 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-d45930e2-9084-4522-a8f3-52013d9d8856 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:41.948152 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-d45930e2-9084-4522-a8f3-52013d9d8856 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:41.954538 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d45930e2-9084-4522-a8f3-52013d9d8856 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:41.954991 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d45930e2-9084-4522-a8f3-52013d9d8856 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:41.955808 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d45930e2-9084-4522-a8f3-52013d9d8856 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:41.956273 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d45930e2-9084-4522-a8f3-52013d9d8856 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:42.090201 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-d45930e2-9084-4522-a8f3-52013d9d8856 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:42.098862 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-d45930e2-9084-4522-a8f3-52013d9d8856 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1321 microversion: 2.1 time: 0.155092 May 26 15:09:42.099468 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 100/178] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:41 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:09:42.425199 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-fb91f347-5039-4ced-bb6d-9db67e1b720f tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:42.425807 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-fb91f347-5039-4ced-bb6d-9db67e1b720f tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:42.432252 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fb91f347-5039-4ced-bb6d-9db67e1b720f tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:42.432740 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fb91f347-5039-4ced-bb6d-9db67e1b720f tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:42.433605 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fb91f347-5039-4ced-bb6d-9db67e1b720f tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:42.434093 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fb91f347-5039-4ced-bb6d-9db67e1b720f tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:42.564101 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-fb91f347-5039-4ced-bb6d-9db67e1b720f tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:42.572166 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-fb91f347-5039-4ced-bb6d-9db67e1b720f tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1362 microversion: 2.1 time: 0.151736 May 26 15:09:42.572741 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 101/179] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:42 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:09:42.646377 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-2cd504f6-e43c-41f0-a666-bfb200a9a45f tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:42.646994 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-2cd504f6-e43c-41f0-a666-bfb200a9a45f tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:42.653339 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2cd504f6-e43c-41f0-a666-bfb200a9a45f tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:42.653771 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2cd504f6-e43c-41f0-a666-bfb200a9a45f tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:42.654536 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2cd504f6-e43c-41f0-a666-bfb200a9a45f tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:42.655183 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2cd504f6-e43c-41f0-a666-bfb200a9a45f tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:42.796076 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-2cd504f6-e43c-41f0-a666-bfb200a9a45f tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:42.804012 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-2cd504f6-e43c-41f0-a666-bfb200a9a45f tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1367 microversion: 2.1 time: 0.161803 May 26 15:09:42.804761 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 102/180] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:42 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:09:42.951572 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-e68b2438-ad18-464a-b133-1fbe5bebddb5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:42.953171 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-e68b2438-ad18-464a-b133-1fbe5bebddb5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:42.959882 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e68b2438-ad18-464a-b133-1fbe5bebddb5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:42.960332 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e68b2438-ad18-464a-b133-1fbe5bebddb5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:42.961142 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e68b2438-ad18-464a-b133-1fbe5bebddb5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:42.961577 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e68b2438-ad18-464a-b133-1fbe5bebddb5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:43.118397 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-e68b2438-ad18-464a-b133-1fbe5bebddb5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:43.127426 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-e68b2438-ad18-464a-b133-1fbe5bebddb5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:43.129082 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-e68b2438-ad18-464a-b133-1fbe5bebddb5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:43.130381 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-e68b2438-ad18-464a-b133-1fbe5bebddb5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1406 microversion: 2.20 time: 0.183594 May 26 15:09:43.130948 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 103/181] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:09:42 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:09:43.135744 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-68e0846e-c72e-4835-a32d-8729ba60a002 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:43.136339 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-68e0846e-c72e-4835-a32d-8729ba60a002 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:43.146696 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-68e0846e-c72e-4835-a32d-8729ba60a002 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:43.147214 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-68e0846e-c72e-4835-a32d-8729ba60a002 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:43.148001 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-68e0846e-c72e-4835-a32d-8729ba60a002 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:43.148450 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-68e0846e-c72e-4835-a32d-8729ba60a002 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:43.288746 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-68e0846e-c72e-4835-a32d-8729ba60a002 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:43.296248 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-68e0846e-c72e-4835-a32d-8729ba60a002 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1321 microversion: 2.1 time: 0.164072 May 26 15:09:43.296816 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 104/182] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:43 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:43.301217 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-2c823ce7-e04b-4e99-b69f-9f65170c6459 req-eb279265-0d7f-4573-8d3f-ca5e51940186 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d9c670-e34a-4363-9e60-745335a3ea6c", "name": "network-vif-plugged", "status": "completed", "tag": "594748ba-cf8f-4cb8-bfc4-dba073613057"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:43.309554 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-2c823ce7-e04b-4e99-b69f-9f65170c6459 req-eb279265-0d7f-4573-8d3f-ca5e51940186 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:43.310000 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-2c823ce7-e04b-4e99-b69f-9f65170c6459 req-eb279265-0d7f-4573-8d3f-ca5e51940186 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:43.322759 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-2c823ce7-e04b-4e99-b69f-9f65170c6459 req-eb279265-0d7f-4573-8d3f-ca5e51940186 service nova] Creating event network-vif-plugged:594748ba-cf8f-4cb8-bfc4-dba073613057 for instance 29d9c670-e34a-4363-9e60-745335a3ea6c on hv-cinder-84301 May 26 15:09:43.329496 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-2c823ce7-e04b-4e99-b69f-9f65170c6459 req-eb279265-0d7f-4573-8d3f-ca5e51940186 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031512 May 26 15:09:43.330113 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 105/183] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:09:43.590086 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-10ce0276-a957-40b2-a44f-a91dbda271d2 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:43.590777 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-10ce0276-a957-40b2-a44f-a91dbda271d2 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:43.598456 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-10ce0276-a957-40b2-a44f-a91dbda271d2 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:43.599030 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-10ce0276-a957-40b2-a44f-a91dbda271d2 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:43.599828 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-10ce0276-a957-40b2-a44f-a91dbda271d2 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:43.600348 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-10ce0276-a957-40b2-a44f-a91dbda271d2 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:43.744026 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-10ce0276-a957-40b2-a44f-a91dbda271d2 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:43.752155 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-10ce0276-a957-40b2-a44f-a91dbda271d2 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1362 microversion: 2.1 time: 0.166131 May 26 15:09:43.752747 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 106/184] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:43 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:09:43.821841 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-1e38417a-28c4-4851-8588-dc65a54d73e3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:43.822451 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-1e38417a-28c4-4851-8588-dc65a54d73e3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:43.830001 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1e38417a-28c4-4851-8588-dc65a54d73e3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:43.830444 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1e38417a-28c4-4851-8588-dc65a54d73e3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:43.831269 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1e38417a-28c4-4851-8588-dc65a54d73e3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:43.831697 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1e38417a-28c4-4851-8588-dc65a54d73e3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:43.847677 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=100 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:43.976660 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-1e38417a-28c4-4851-8588-dc65a54d73e3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:43.989708 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-1e38417a-28c4-4851-8588-dc65a54d73e3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1367 microversion: 2.1 time: 0.170442 May 26 15:09:43.989708 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 107/185] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:43 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:09:44.152059 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-f3f603ca-f396-4553-a17b-c77725b23eb6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:44.152677 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-f3f603ca-f396-4553-a17b-c77725b23eb6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:44.159905 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f3f603ca-f396-4553-a17b-c77725b23eb6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:44.160345 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f3f603ca-f396-4553-a17b-c77725b23eb6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:44.161526 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f3f603ca-f396-4553-a17b-c77725b23eb6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:44.162299 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f3f603ca-f396-4553-a17b-c77725b23eb6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:44.302372 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-f3f603ca-f396-4553-a17b-c77725b23eb6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:44.310647 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-f3f603ca-f396-4553-a17b-c77725b23eb6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:44.313602 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-f3f603ca-f396-4553-a17b-c77725b23eb6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:44.314732 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-f3f603ca-f396-4553-a17b-c77725b23eb6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1406 microversion: 2.20 time: 0.169146 May 26 15:09:44.315492 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 108/186] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:09:44 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:09:44.331245 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-a89e99bb-88e1-42e7-a4c5-a560037a4810 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:44.331865 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-a89e99bb-88e1-42e7-a4c5-a560037a4810 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:44.337990 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a89e99bb-88e1-42e7-a4c5-a560037a4810 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:44.338436 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a89e99bb-88e1-42e7-a4c5-a560037a4810 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:44.339257 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a89e99bb-88e1-42e7-a4c5-a560037a4810 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:44.339711 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a89e99bb-88e1-42e7-a4c5-a560037a4810 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:44.475620 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-a89e99bb-88e1-42e7-a4c5-a560037a4810 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:44.483126 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-a89e99bb-88e1-42e7-a4c5-a560037a4810 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1321 microversion: 2.1 time: 0.156252 May 26 15:09:44.484252 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 109/187] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:44 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:44.771841 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-12f6978c-1e69-41bb-844e-0e4a664f148a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:44.772823 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-12f6978c-1e69-41bb-844e-0e4a664f148a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:44.779491 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-12f6978c-1e69-41bb-844e-0e4a664f148a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:44.779943 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-12f6978c-1e69-41bb-844e-0e4a664f148a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:44.782283 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-12f6978c-1e69-41bb-844e-0e4a664f148a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:44.783004 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-12f6978c-1e69-41bb-844e-0e4a664f148a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:45.019184 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-12f6978c-1e69-41bb-844e-0e4a664f148a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:45.070339 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-12f6978c-1e69-41bb-844e-0e4a664f148a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1362 microversion: 2.1 time: 0.297933 May 26 15:09:45.071016 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 110/188] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:44 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1362 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:09:45.092514 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-53e8060f-b831-4875-976f-946b73b30df0 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:45.095003 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-53e8060f-b831-4875-976f-946b73b30df0 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:45.132557 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-53e8060f-b831-4875-976f-946b73b30df0 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:45.135892 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-53e8060f-b831-4875-976f-946b73b30df0 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:45.137002 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-53e8060f-b831-4875-976f-946b73b30df0 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:45.140234 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-53e8060f-b831-4875-976f-946b73b30df0 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:45.259170 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-fb93547c-1474-4139-a9c9-5460882f586a tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "POST /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.427158 May 26 15:09:45.262604 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 79/189] 10.222.0.45 () {60 vars in 1322 bytes} [Thu May 26 15:09:39 2022] POST /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817/os-volume_attachments => generated 194 bytes in 5431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:09:45.334725 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-fa00d0a1-bd53-4b5e-a4c6-87a3512c972e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:45.335575 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-fa00d0a1-bd53-4b5e-a4c6-87a3512c972e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:45.350872 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fa00d0a1-bd53-4b5e-a4c6-87a3512c972e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:45.353667 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fa00d0a1-bd53-4b5e-a4c6-87a3512c972e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:45.363775 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fa00d0a1-bd53-4b5e-a4c6-87a3512c972e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:45.363775 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fa00d0a1-bd53-4b5e-a4c6-87a3512c972e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:45.512834 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-53e8060f-b831-4875-976f-946b73b30df0 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:45.528259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-53e8060f-b831-4875-976f-946b73b30df0 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1367 microversion: 2.1 time: 0.455627 May 26 15:09:45.549301 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 111/190] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:45 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1367 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:45.554527 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-5745e675-ac64-490c-b8e6-f4baf5822f8e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:45.555390 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-5745e675-ac64-490c-b8e6-f4baf5822f8e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:45.568911 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5745e675-ac64-490c-b8e6-f4baf5822f8e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:45.569650 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5745e675-ac64-490c-b8e6-f4baf5822f8e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:45.570574 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5745e675-ac64-490c-b8e6-f4baf5822f8e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:45.571178 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5745e675-ac64-490c-b8e6-f4baf5822f8e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:45.792666 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-fa00d0a1-bd53-4b5e-a4c6-87a3512c972e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:45.803854 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-fa00d0a1-bd53-4b5e-a4c6-87a3512c972e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:45.805585 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-fa00d0a1-bd53-4b5e-a4c6-87a3512c972e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:45.807041 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-fa00d0a1-bd53-4b5e-a4c6-87a3512c972e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1406 microversion: 2.20 time: 0.476473 May 26 15:09:45.807704 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 80/191] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:09:45 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1406 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:09:45.844687 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-5745e675-ac64-490c-b8e6-f4baf5822f8e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:45.855292 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-5745e675-ac64-490c-b8e6-f4baf5822f8e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1321 microversion: 2.1 time: 0.304756 May 26 15:09:45.856189 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 112/192] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:45 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1321 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:46.087738 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-14e5c79a-8c67-437f-8c67-a18e26f7c0c8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:46.088758 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-14e5c79a-8c67-437f-8c67-a18e26f7c0c8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:46.096571 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-14e5c79a-8c67-437f-8c67-a18e26f7c0c8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:46.097007 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-14e5c79a-8c67-437f-8c67-a18e26f7c0c8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:46.097788 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-14e5c79a-8c67-437f-8c67-a18e26f7c0c8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:46.098228 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-14e5c79a-8c67-437f-8c67-a18e26f7c0c8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:46.395898 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-14e5c79a-8c67-437f-8c67-a18e26f7c0c8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:46.411474 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-14e5c79a-8c67-437f-8c67-a18e26f7c0c8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1362 microversion: 2.1 time: 0.326826 May 26 15:09:46.412678 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 81/193] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:46 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1362 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:46.557406 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-8c8fb128-f92c-4f02-8d89-a52c55443c80 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:46.558198 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-8c8fb128-f92c-4f02-8d89-a52c55443c80 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:46.568952 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8c8fb128-f92c-4f02-8d89-a52c55443c80 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:46.569478 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8c8fb128-f92c-4f02-8d89-a52c55443c80 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:46.570401 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8c8fb128-f92c-4f02-8d89-a52c55443c80 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:46.571001 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8c8fb128-f92c-4f02-8d89-a52c55443c80 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:46.721676 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-8c8fb128-f92c-4f02-8d89-a52c55443c80 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:46.729349 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-8c8fb128-f92c-4f02-8d89-a52c55443c80 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1367 microversion: 2.1 time: 0.176030 May 26 15:09:46.730182 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 113/194] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:46 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:46.826794 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e652682a-3a0a-4a3c-ad67-6b2ace5677b0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:46.828262 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e652682a-3a0a-4a3c-ad67-6b2ace5677b0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:46.835411 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e652682a-3a0a-4a3c-ad67-6b2ace5677b0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:46.835860 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e652682a-3a0a-4a3c-ad67-6b2ace5677b0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:46.836638 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e652682a-3a0a-4a3c-ad67-6b2ace5677b0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:46.837078 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e652682a-3a0a-4a3c-ad67-6b2ace5677b0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:46.872027 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-8034ac64-0c9a-4b73-a1dd-176bd6eab893 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:46.875120 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-8034ac64-0c9a-4b73-a1dd-176bd6eab893 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:46.881735 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8034ac64-0c9a-4b73-a1dd-176bd6eab893 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:46.882340 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8034ac64-0c9a-4b73-a1dd-176bd6eab893 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:46.883307 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8034ac64-0c9a-4b73-a1dd-176bd6eab893 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:46.884082 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8034ac64-0c9a-4b73-a1dd-176bd6eab893 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:47.050589 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e652682a-3a0a-4a3c-ad67-6b2ace5677b0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:47.061660 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e652682a-3a0a-4a3c-ad67-6b2ace5677b0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:47.064913 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e652682a-3a0a-4a3c-ad67-6b2ace5677b0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:47.068764 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e652682a-3a0a-4a3c-ad67-6b2ace5677b0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1406 microversion: 2.20 time: 0.246211 May 26 15:09:47.080421 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 82/195] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:09:46 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1406 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:09:47.090491 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-8034ac64-0c9a-4b73-a1dd-176bd6eab893 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:47.099959 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-8034ac64-0c9a-4b73-a1dd-176bd6eab893 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1321 microversion: 2.1 time: 0.231858 May 26 15:09:47.100536 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 114/196] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:46 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:09:47.432402 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e25e1268-8461-4a70-90fe-63dd25ec7d6e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:47.433793 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e25e1268-8461-4a70-90fe-63dd25ec7d6e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:47.442872 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e25e1268-8461-4a70-90fe-63dd25ec7d6e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:47.443516 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e25e1268-8461-4a70-90fe-63dd25ec7d6e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:47.444448 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e25e1268-8461-4a70-90fe-63dd25ec7d6e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:47.444869 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e25e1268-8461-4a70-90fe-63dd25ec7d6e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:47.626828 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e25e1268-8461-4a70-90fe-63dd25ec7d6e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:47.634955 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e25e1268-8461-4a70-90fe-63dd25ec7d6e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1362 microversion: 2.1 time: 0.207153 May 26 15:09:47.635763 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 83/197] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:47 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:47.746263 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-1f01f676-4d16-48d4-af25-b6b537d3ac3c tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:47.746893 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-1f01f676-4d16-48d4-af25-b6b537d3ac3c tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:47.753486 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1f01f676-4d16-48d4-af25-b6b537d3ac3c tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:47.753916 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1f01f676-4d16-48d4-af25-b6b537d3ac3c tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:47.755007 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1f01f676-4d16-48d4-af25-b6b537d3ac3c tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:47.755442 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1f01f676-4d16-48d4-af25-b6b537d3ac3c tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:47.888865 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-1f01f676-4d16-48d4-af25-b6b537d3ac3c tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:47.898175 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-1f01f676-4d16-48d4-af25-b6b537d3ac3c tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1367 microversion: 2.1 time: 0.155749 May 26 15:09:47.899010 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 115/198] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:47 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:48.088742 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-2573ad45-634b-4e35-8707-97322ed4cb46 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:48.089968 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-2573ad45-634b-4e35-8707-97322ed4cb46 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:48.097862 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2573ad45-634b-4e35-8707-97322ed4cb46 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:48.098316 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2573ad45-634b-4e35-8707-97322ed4cb46 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:48.099124 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2573ad45-634b-4e35-8707-97322ed4cb46 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:48.099556 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2573ad45-634b-4e35-8707-97322ed4cb46 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:48.119417 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-e69d0e4a-590a-430e-9d6c-7b54df7cfb61 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:48.120093 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-e69d0e4a-590a-430e-9d6c-7b54df7cfb61 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:48.126761 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e69d0e4a-590a-430e-9d6c-7b54df7cfb61 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:48.127233 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e69d0e4a-590a-430e-9d6c-7b54df7cfb61 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:48.127997 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e69d0e4a-590a-430e-9d6c-7b54df7cfb61 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:48.128423 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e69d0e4a-590a-430e-9d6c-7b54df7cfb61 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:48.321094 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2573ad45-634b-4e35-8707-97322ed4cb46 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:48.330080 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2573ad45-634b-4e35-8707-97322ed4cb46 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:48.330785 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-e69d0e4a-590a-430e-9d6c-7b54df7cfb61 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:48.331631 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2573ad45-634b-4e35-8707-97322ed4cb46 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:48.332815 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-2573ad45-634b-4e35-8707-97322ed4cb46 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1406 microversion: 2.20 time: 0.248401 May 26 15:09:48.333377 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 84/199] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:09:48 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1406 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:09:48.339446 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-e69d0e4a-590a-430e-9d6c-7b54df7cfb61 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1321 microversion: 2.1 time: 0.224705 May 26 15:09:48.340454 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 116/200] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:48 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:09:48.652529 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-957fa458-71d3-4b95-b731-2ac6e3b49a91 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:48.653059 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-957fa458-71d3-4b95-b731-2ac6e3b49a91 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:48.659758 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-957fa458-71d3-4b95-b731-2ac6e3b49a91 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:48.660212 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-957fa458-71d3-4b95-b731-2ac6e3b49a91 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:48.660990 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-957fa458-71d3-4b95-b731-2ac6e3b49a91 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:48.661426 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-957fa458-71d3-4b95-b731-2ac6e3b49a91 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:48.800835 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-957fa458-71d3-4b95-b731-2ac6e3b49a91 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:48.809626 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-957fa458-71d3-4b95-b731-2ac6e3b49a91 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1362 microversion: 2.1 time: 0.160998 May 26 15:09:48.810220 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 85/201] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:48 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:09:48.916811 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-9028095b-5215-4fec-969e-71e48ed16c7a tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:48.917532 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-9028095b-5215-4fec-969e-71e48ed16c7a tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:48.924948 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9028095b-5215-4fec-969e-71e48ed16c7a tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:48.925389 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9028095b-5215-4fec-969e-71e48ed16c7a tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:48.926151 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9028095b-5215-4fec-969e-71e48ed16c7a tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:48.926573 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9028095b-5215-4fec-969e-71e48ed16c7a tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:49.066680 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-9028095b-5215-4fec-969e-71e48ed16c7a tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:49.074394 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-9028095b-5215-4fec-969e-71e48ed16c7a tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1367 microversion: 2.1 time: 0.161647 May 26 15:09:49.074973 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 117/202] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:48 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:49.352520 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-32ac2991-67b6-49e7-9d48-1c06c22496a2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:49.353126 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-32ac2991-67b6-49e7-9d48-1c06c22496a2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:49.357643 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-6d275d0a-6125-42cf-9166-2b3139787fd1 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:49.358330 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-6d275d0a-6125-42cf-9166-2b3139787fd1 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:49.360397 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-32ac2991-67b6-49e7-9d48-1c06c22496a2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:49.360844 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-32ac2991-67b6-49e7-9d48-1c06c22496a2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:49.361613 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-32ac2991-67b6-49e7-9d48-1c06c22496a2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:49.362046 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-32ac2991-67b6-49e7-9d48-1c06c22496a2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:49.364936 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6d275d0a-6125-42cf-9166-2b3139787fd1 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:49.365392 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6d275d0a-6125-42cf-9166-2b3139787fd1 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:49.366194 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6d275d0a-6125-42cf-9166-2b3139787fd1 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:49.366631 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6d275d0a-6125-42cf-9166-2b3139787fd1 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:49.568964 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-6d275d0a-6125-42cf-9166-2b3139787fd1 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:49.574731 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-32ac2991-67b6-49e7-9d48-1c06c22496a2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:49.582664 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-6d275d0a-6125-42cf-9166-2b3139787fd1 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1321 microversion: 2.1 time: 0.228482 May 26 15:09:49.583785 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 118/203] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:49 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:09:49.593469 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-32ac2991-67b6-49e7-9d48-1c06c22496a2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:49.597011 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-32ac2991-67b6-49e7-9d48-1c06c22496a2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:49.600162 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-32ac2991-67b6-49e7-9d48-1c06c22496a2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1406 microversion: 2.20 time: 0.251233 May 26 15:09:49.601211 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 86/204] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:09:49 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1406 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:09:49.828960 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-5720b37c-9ff5-4687-8561-2145e0eafad2 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:49.829599 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-5720b37c-9ff5-4687-8561-2145e0eafad2 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:49.835747 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5720b37c-9ff5-4687-8561-2145e0eafad2 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:49.836198 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5720b37c-9ff5-4687-8561-2145e0eafad2 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:49.836968 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5720b37c-9ff5-4687-8561-2145e0eafad2 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:49.837399 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5720b37c-9ff5-4687-8561-2145e0eafad2 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:49.973369 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-5720b37c-9ff5-4687-8561-2145e0eafad2 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:49.980925 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-5720b37c-9ff5-4687-8561-2145e0eafad2 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1362 microversion: 2.1 time: 0.156376 May 26 15:09:49.981495 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 119/205] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:49 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:50.092018 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-587065f7-8be9-4d94-8bf2-81609a2b2b7b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:50.093000 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-587065f7-8be9-4d94-8bf2-81609a2b2b7b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:50.100027 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-587065f7-8be9-4d94-8bf2-81609a2b2b7b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:50.100464 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-587065f7-8be9-4d94-8bf2-81609a2b2b7b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:50.101223 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-587065f7-8be9-4d94-8bf2-81609a2b2b7b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:50.101648 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-587065f7-8be9-4d94-8bf2-81609a2b2b7b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:50.238729 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-587065f7-8be9-4d94-8bf2-81609a2b2b7b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:50.246448 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-587065f7-8be9-4d94-8bf2-81609a2b2b7b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1367 microversion: 2.1 time: 0.158691 May 26 15:09:50.247047 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 87/206] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:50 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:50.609226 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-4052def9-b9e2-4058-8689-1bf6ccfa4511 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:50.609828 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-4052def9-b9e2-4058-8689-1bf6ccfa4511 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:50.615926 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4052def9-b9e2-4058-8689-1bf6ccfa4511 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:50.616364 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4052def9-b9e2-4058-8689-1bf6ccfa4511 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:50.617125 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4052def9-b9e2-4058-8689-1bf6ccfa4511 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:50.617554 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4052def9-b9e2-4058-8689-1bf6ccfa4511 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:50.619885 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-874b625c-e5d1-4dcb-8611-9ccfad588904 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:50.620543 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-874b625c-e5d1-4dcb-8611-9ccfad588904 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:50.626744 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-874b625c-e5d1-4dcb-8611-9ccfad588904 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:50.627243 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-874b625c-e5d1-4dcb-8611-9ccfad588904 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:50.628046 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-874b625c-e5d1-4dcb-8611-9ccfad588904 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:50.628535 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-874b625c-e5d1-4dcb-8611-9ccfad588904 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:51.036638 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-4052def9-b9e2-4058-8689-1bf6ccfa4511 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:51.044346 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-4052def9-b9e2-4058-8689-1bf6ccfa4511 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1321 microversion: 2.1 time: 0.439245 May 26 15:09:51.044935 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 120/207] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:50 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1321 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:51.049574 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-874b625c-e5d1-4dcb-8611-9ccfad588904 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:51.049753 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-8d497a08-9a76-47f1-bf5a-0f356df81063 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:51.050268 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-8d497a08-9a76-47f1-bf5a-0f356df81063 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:51.056522 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8d497a08-9a76-47f1-bf5a-0f356df81063 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:51.056966 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8d497a08-9a76-47f1-bf5a-0f356df81063 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:51.057753 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8d497a08-9a76-47f1-bf5a-0f356df81063 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:51.058161 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-874b625c-e5d1-4dcb-8611-9ccfad588904 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:51.058276 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8d497a08-9a76-47f1-bf5a-0f356df81063 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:51.059714 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-874b625c-e5d1-4dcb-8611-9ccfad588904 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:51.060875 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-874b625c-e5d1-4dcb-8611-9ccfad588904 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1406 microversion: 2.20 time: 0.445002 May 26 15:09:51.062201 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 88/208] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:09:50 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1406 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:09:51.187907 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-8d497a08-9a76-47f1-bf5a-0f356df81063 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:51.195755 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-8d497a08-9a76-47f1-bf5a-0f356df81063 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1362 microversion: 2.1 time: 0.149857 May 26 15:09:51.196322 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 121/209] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:51 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:51.263873 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-76cb92be-65f3-454e-b804-a0cb8c3731d5 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:51.264469 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-76cb92be-65f3-454e-b804-a0cb8c3731d5 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:51.270981 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-76cb92be-65f3-454e-b804-a0cb8c3731d5 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:51.271472 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-76cb92be-65f3-454e-b804-a0cb8c3731d5 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:51.272246 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-76cb92be-65f3-454e-b804-a0cb8c3731d5 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:51.272679 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-76cb92be-65f3-454e-b804-a0cb8c3731d5 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:51.401546 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-76cb92be-65f3-454e-b804-a0cb8c3731d5 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:51.409233 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-76cb92be-65f3-454e-b804-a0cb8c3731d5 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1367 microversion: 2.1 time: 0.149179 May 26 15:09:51.409835 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 89/210] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:51 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:51.636843 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-d56d370f-97cf-43a5-8df7-5b4b71066103 req-4dd1a438-3c7c-47cd-a8ee-b1b93da7a062 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6", "name": "network-vif-plugged", "status": "completed", "tag": "6342ec5c-6f4f-42ae-aaeb-2f79c05fef02"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:51.651476 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-d56d370f-97cf-43a5-8df7-5b4b71066103 req-4dd1a438-3c7c-47cd-a8ee-b1b93da7a062 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:51.651923 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-d56d370f-97cf-43a5-8df7-5b4b71066103 req-4dd1a438-3c7c-47cd-a8ee-b1b93da7a062 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:51.668283 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-d56d370f-97cf-43a5-8df7-5b4b71066103 req-4dd1a438-3c7c-47cd-a8ee-b1b93da7a062 service nova] Creating event network-vif-plugged:6342ec5c-6f4f-42ae-aaeb-2f79c05fef02 for instance 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 on hv-cinder-84301 May 26 15:09:51.675613 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-d56d370f-97cf-43a5-8df7-5b4b71066103 req-4dd1a438-3c7c-47cd-a8ee-b1b93da7a062 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042839 May 26 15:09:51.676262 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 122/211] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:09:52.061039 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-5a1c6ce9-5bf4-4f93-8dac-6eaeced6d902 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:52.062291 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-5a1c6ce9-5bf4-4f93-8dac-6eaeced6d902 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:52.068407 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5a1c6ce9-5bf4-4f93-8dac-6eaeced6d902 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:52.068738 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5a1c6ce9-5bf4-4f93-8dac-6eaeced6d902 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:52.069495 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5a1c6ce9-5bf4-4f93-8dac-6eaeced6d902 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:52.069925 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5a1c6ce9-5bf4-4f93-8dac-6eaeced6d902 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:52.083437 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-215b64ec-bb76-42f6-8b73-e8981072096c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:52.084259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-215b64ec-bb76-42f6-8b73-e8981072096c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:52.086264 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_api:SELECT=100 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:52.092099 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-215b64ec-bb76-42f6-8b73-e8981072096c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:52.092954 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-215b64ec-bb76-42f6-8b73-e8981072096c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:52.094289 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-215b64ec-bb76-42f6-8b73-e8981072096c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:52.094886 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-215b64ec-bb76-42f6-8b73-e8981072096c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:52.278678 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-5a1c6ce9-5bf4-4f93-8dac-6eaeced6d902 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:52.282906 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-215b64ec-bb76-42f6-8b73-e8981072096c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:52.287559 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-5a1c6ce9-5bf4-4f93-8dac-6eaeced6d902 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1321 microversion: 2.1 time: 0.230297 May 26 15:09:52.288420 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 90/212] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:52 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:52.291628 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-215b64ec-bb76-42f6-8b73-e8981072096c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:52.293220 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-215b64ec-bb76-42f6-8b73-e8981072096c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:52.294427 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-215b64ec-bb76-42f6-8b73-e8981072096c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1406 microversion: 2.20 time: 0.215993 May 26 15:09:52.295058 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 123/213] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:09:52 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:09:52.303299 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1f93696f-b2f9-4c81-89fd-59f1180d5389 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:52.303299 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1f93696f-b2f9-4c81-89fd-59f1180d5389 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:52.310134 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1f93696f-b2f9-4c81-89fd-59f1180d5389 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:52.310587 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1f93696f-b2f9-4c81-89fd-59f1180d5389 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:52.312252 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1f93696f-b2f9-4c81-89fd-59f1180d5389 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:52.312702 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1f93696f-b2f9-4c81-89fd-59f1180d5389 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:52.426841 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-44e4bc29-3017-474f-838b-f4fb3722d34c tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:52.427808 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-44e4bc29-3017-474f-838b-f4fb3722d34c tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:52.435062 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-44e4bc29-3017-474f-838b-f4fb3722d34c tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:52.435738 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-44e4bc29-3017-474f-838b-f4fb3722d34c tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:52.437197 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-44e4bc29-3017-474f-838b-f4fb3722d34c tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:52.437919 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-44e4bc29-3017-474f-838b-f4fb3722d34c tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:52.459149 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1f93696f-b2f9-4c81-89fd-59f1180d5389 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:52.467080 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1f93696f-b2f9-4c81-89fd-59f1180d5389 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1362 microversion: 2.1 time: 0.168347 May 26 15:09:52.468994 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 91/214] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:52 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:52.573475 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-44e4bc29-3017-474f-838b-f4fb3722d34c tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:52.575727 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=100 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:52.583713 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-44e4bc29-3017-474f-838b-f4fb3722d34c tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1367 microversion: 2.1 time: 0.160748 May 26 15:09:52.587009 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 124/215] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:52 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:53.305101 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-3bc1e302-c1b4-4d80-a62f-2fac01894a71 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:53.305636 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-3bc1e302-c1b4-4d80-a62f-2fac01894a71 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:53.312571 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3bc1e302-c1b4-4d80-a62f-2fac01894a71 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:53.313010 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3bc1e302-c1b4-4d80-a62f-2fac01894a71 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:53.313114 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-503cc417-3d88-418d-a94e-2585a2b9c134 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:53.313677 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-503cc417-3d88-418d-a94e-2585a2b9c134 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:53.313798 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3bc1e302-c1b4-4d80-a62f-2fac01894a71 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:53.314194 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3bc1e302-c1b4-4d80-a62f-2fac01894a71 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:53.319881 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-503cc417-3d88-418d-a94e-2585a2b9c134 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:53.320351 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-503cc417-3d88-418d-a94e-2585a2b9c134 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:53.321101 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-503cc417-3d88-418d-a94e-2585a2b9c134 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:53.321528 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-503cc417-3d88-418d-a94e-2585a2b9c134 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:53.459213 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-3bc1e302-c1b4-4d80-a62f-2fac01894a71 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:53.467326 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-3bc1e302-c1b4-4d80-a62f-2fac01894a71 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1321 microversion: 2.1 time: 0.166074 May 26 15:09:53.468579 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 92/216] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:53 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:53.485150 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-0c1124ba-accb-402c-b76d-209072ae191e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:53.485854 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-0c1124ba-accb-402c-b76d-209072ae191e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:53.491918 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0c1124ba-accb-402c-b76d-209072ae191e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:53.492363 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0c1124ba-accb-402c-b76d-209072ae191e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:53.493128 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0c1124ba-accb-402c-b76d-209072ae191e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:53.493558 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0c1124ba-accb-402c-b76d-209072ae191e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:53.666438 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-503cc417-3d88-418d-a94e-2585a2b9c134 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:53.674313 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-0c1124ba-accb-402c-b76d-209072ae191e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:53.675628 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-503cc417-3d88-418d-a94e-2585a2b9c134 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:53.677496 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-503cc417-3d88-418d-a94e-2585a2b9c134 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:53.678999 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-503cc417-3d88-418d-a94e-2585a2b9c134 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1406 microversion: 2.20 time: 0.369678 May 26 15:09:53.680129 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 125/217] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:09:53 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1406 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:09:53.682605 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-0c1124ba-accb-402c-b76d-209072ae191e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1362 microversion: 2.1 time: 0.201366 May 26 15:09:53.683189 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 93/218] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:53 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1362 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:53.689166 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-9b551a78-cf23-4bd7-bb3d-9a3f320ea4ad tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:53.690560 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-9b551a78-cf23-4bd7-bb3d-9a3f320ea4ad tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:53.700291 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9b551a78-cf23-4bd7-bb3d-9a3f320ea4ad tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:53.700768 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9b551a78-cf23-4bd7-bb3d-9a3f320ea4ad tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:53.701538 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9b551a78-cf23-4bd7-bb3d-9a3f320ea4ad tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:53.702248 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9b551a78-cf23-4bd7-bb3d-9a3f320ea4ad tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:53.838577 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-9b551a78-cf23-4bd7-bb3d-9a3f320ea4ad tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:53.847432 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-9b551a78-cf23-4bd7-bb3d-9a3f320ea4ad tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1367 microversion: 2.1 time: 0.165696 May 26 15:09:53.848014 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 126/219] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:53 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:54.485168 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1993075f-a3c8-4239-84e7-d42e41a452f7 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:54.485695 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1993075f-a3c8-4239-84e7-d42e41a452f7 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:54.492451 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1993075f-a3c8-4239-84e7-d42e41a452f7 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:54.492926 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1993075f-a3c8-4239-84e7-d42e41a452f7 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:54.493696 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1993075f-a3c8-4239-84e7-d42e41a452f7 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:54.494128 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1993075f-a3c8-4239-84e7-d42e41a452f7 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:54.497215 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:54.632886 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1993075f-a3c8-4239-84e7-d42e41a452f7 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:54.643726 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1993075f-a3c8-4239-84e7-d42e41a452f7 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1321 microversion: 2.1 time: 0.162740 May 26 15:09:54.644312 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 94/220] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:54 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:54.700546 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-4bbc4995-501c-4943-902d-91545cfc57b4 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:54.701147 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-4bbc4995-501c-4943-902d-91545cfc57b4 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:54.706364 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-cd8dbfbe-f846-42db-b918-b54bf5bb9d33 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:54.707001 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-cd8dbfbe-f846-42db-b918-b54bf5bb9d33 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:54.708244 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4bbc4995-501c-4943-902d-91545cfc57b4 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:54.708729 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4bbc4995-501c-4943-902d-91545cfc57b4 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:54.709542 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4bbc4995-501c-4943-902d-91545cfc57b4 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:54.709979 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4bbc4995-501c-4943-902d-91545cfc57b4 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:54.712921 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cd8dbfbe-f846-42db-b918-b54bf5bb9d33 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:54.713359 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cd8dbfbe-f846-42db-b918-b54bf5bb9d33 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:54.714126 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cd8dbfbe-f846-42db-b918-b54bf5bb9d33 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:54.714550 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cd8dbfbe-f846-42db-b918-b54bf5bb9d33 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:54.916036 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-4bbc4995-501c-4943-902d-91545cfc57b4 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:54.922406 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-cd8dbfbe-f846-42db-b918-b54bf5bb9d33 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:54.929315 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-4bbc4995-501c-4943-902d-91545cfc57b4 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1362 microversion: 2.1 time: 0.232477 May 26 15:09:54.930116 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 127/221] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:54 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:54.930573 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-cd8dbfbe-f846-42db-b918-b54bf5bb9d33 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:54.932173 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-cd8dbfbe-f846-42db-b918-b54bf5bb9d33 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:54.933302 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-cd8dbfbe-f846-42db-b918-b54bf5bb9d33 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1406 microversion: 2.20 time: 0.231506 May 26 15:09:54.934020 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 95/222] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:09:54 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1406 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:09:54.934773 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-1ad8cc4e-5bfd-438f-89e6-139aad905bb8 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:54.935424 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-1ad8cc4e-5bfd-438f-89e6-139aad905bb8 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:54.942844 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1ad8cc4e-5bfd-438f-89e6-139aad905bb8 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:54.943341 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1ad8cc4e-5bfd-438f-89e6-139aad905bb8 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:54.944118 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1ad8cc4e-5bfd-438f-89e6-139aad905bb8 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:54.944554 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1ad8cc4e-5bfd-438f-89e6-139aad905bb8 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:55.083363 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-1ad8cc4e-5bfd-438f-89e6-139aad905bb8 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:55.091031 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-1ad8cc4e-5bfd-438f-89e6-139aad905bb8 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1367 microversion: 2.1 time: 0.159888 May 26 15:09:55.091664 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 128/223] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:54 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:55.661668 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ca04a456-dc11-4ce3-816e-1d911eab8d7b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:55.662443 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ca04a456-dc11-4ce3-816e-1d911eab8d7b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:55.668966 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ca04a456-dc11-4ce3-816e-1d911eab8d7b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:55.669418 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ca04a456-dc11-4ce3-816e-1d911eab8d7b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:55.670195 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ca04a456-dc11-4ce3-816e-1d911eab8d7b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:55.670759 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ca04a456-dc11-4ce3-816e-1d911eab8d7b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:55.800213 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ca04a456-dc11-4ce3-816e-1d911eab8d7b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:55.807760 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ca04a456-dc11-4ce3-816e-1d911eab8d7b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1321 microversion: 2.1 time: 0.149992 May 26 15:09:55.808342 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 96/224] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:55 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:55.946625 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-24808375-a26f-4bcc-acbf-154aa87cb75b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:55.947354 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-24808375-a26f-4bcc-acbf-154aa87cb75b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:55.953614 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a7b802a1-5da2-46ae-bd5f-b9f5743abb21 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:55.954491 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a7b802a1-5da2-46ae-bd5f-b9f5743abb21 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:55.954626 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-24808375-a26f-4bcc-acbf-154aa87cb75b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:55.955081 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-24808375-a26f-4bcc-acbf-154aa87cb75b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:55.955884 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-24808375-a26f-4bcc-acbf-154aa87cb75b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:55.956313 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-24808375-a26f-4bcc-acbf-154aa87cb75b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:55.960790 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a7b802a1-5da2-46ae-bd5f-b9f5743abb21 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:55.961019 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a7b802a1-5da2-46ae-bd5f-b9f5743abb21 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:55.961797 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a7b802a1-5da2-46ae-bd5f-b9f5743abb21 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:55.962248 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a7b802a1-5da2-46ae-bd5f-b9f5743abb21 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:56.177170 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-24808375-a26f-4bcc-acbf-154aa87cb75b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:56.180166 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a7b802a1-5da2-46ae-bd5f-b9f5743abb21 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:56.185045 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-24808375-a26f-4bcc-acbf-154aa87cb75b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1362 microversion: 2.1 time: 0.242044 May 26 15:09:56.185741 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 129/225] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:55 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1362 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:56.189515 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a7b802a1-5da2-46ae-bd5f-b9f5743abb21 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:56.190667 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-f313c398-a856-4f9a-ae1a-bbc33d9096c6 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:56.191006 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a7b802a1-5da2-46ae-bd5f-b9f5743abb21 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:56.191310 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-f313c398-a856-4f9a-ae1a-bbc33d9096c6 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:56.192132 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a7b802a1-5da2-46ae-bd5f-b9f5743abb21 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1406 microversion: 2.20 time: 0.243105 May 26 15:09:56.192898 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 97/226] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:09:55 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1406 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:09:56.197613 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f313c398-a856-4f9a-ae1a-bbc33d9096c6 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:56.198065 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f313c398-a856-4f9a-ae1a-bbc33d9096c6 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:56.198893 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f313c398-a856-4f9a-ae1a-bbc33d9096c6 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:56.199382 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f313c398-a856-4f9a-ae1a-bbc33d9096c6 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:56.346219 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-f313c398-a856-4f9a-ae1a-bbc33d9096c6 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:56.354156 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-f313c398-a856-4f9a-ae1a-bbc33d9096c6 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1367 microversion: 2.1 time: 0.167556 May 26 15:09:56.354734 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 130/227] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:56 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:56.826072 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-025efea1-aea9-4ae7-8d81-328d6a289f07 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:56.826704 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-025efea1-aea9-4ae7-8d81-328d6a289f07 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:56.834178 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-025efea1-aea9-4ae7-8d81-328d6a289f07 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:56.834688 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-025efea1-aea9-4ae7-8d81-328d6a289f07 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:56.835610 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-025efea1-aea9-4ae7-8d81-328d6a289f07 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:56.836139 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-025efea1-aea9-4ae7-8d81-328d6a289f07 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:56.983647 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-025efea1-aea9-4ae7-8d81-328d6a289f07 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:56.991212 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-025efea1-aea9-4ae7-8d81-328d6a289f07 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1515 microversion: 2.1 time: 0.169598 May 26 15:09:56.991771 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 98/228] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:56 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:09:57.008128 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-a61433f5-0f53-4f03-9886-ff94bd5d6a00 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:57.009756 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-a61433f5-0f53-4f03-9886-ff94bd5d6a00 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:57.015949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a61433f5-0f53-4f03-9886-ff94bd5d6a00 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:57.016395 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a61433f5-0f53-4f03-9886-ff94bd5d6a00 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:57.017158 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a61433f5-0f53-4f03-9886-ff94bd5d6a00 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:57.017583 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a61433f5-0f53-4f03-9886-ff94bd5d6a00 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:57.082884 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.objects.instance [None req-a61433f5-0f53-4f03-9886-ff94bd5d6a00 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lazy-loading 'flavor' on Instance uuid 44b285a0-afad-471d-8d28-7e8972acca1a {{(pid=117799) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:09:57.204120 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ec3fac5d-1e50-4ce8-8403-b1803371fff2 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:57.206733 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ec3fac5d-1e50-4ce8-8403-b1803371fff2 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:57.210477 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=86 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:57.211731 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-a61433f5-0f53-4f03-9886-ff94bd5d6a00 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "POST /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a/action" status: 200 len: 32 microversion: 2.1 time: 0.207546 May 26 15:09:57.212875 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 131/229] 10.222.0.45 () {60 vars in 1277 bytes} [Thu May 26 15:09:57 2022] POST /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a/action => generated 32 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 15:09:57.220349 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-a8d972b2-c7e6-4f19-8b64-9b89129ab761 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:57.221245 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-a8d972b2-c7e6-4f19-8b64-9b89129ab761 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:57.224178 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ec3fac5d-1e50-4ce8-8403-b1803371fff2 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:57.224629 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ec3fac5d-1e50-4ce8-8403-b1803371fff2 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:57.225406 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ec3fac5d-1e50-4ce8-8403-b1803371fff2 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:57.225836 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ec3fac5d-1e50-4ce8-8403-b1803371fff2 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:57.228413 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a8d972b2-c7e6-4f19-8b64-9b89129ab761 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:57.228868 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a8d972b2-c7e6-4f19-8b64-9b89129ab761 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:57.229664 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a8d972b2-c7e6-4f19-8b64-9b89129ab761 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:57.230102 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a8d972b2-c7e6-4f19-8b64-9b89129ab761 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:57.431834 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ec3fac5d-1e50-4ce8-8403-b1803371fff2 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:57.438949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-a8d972b2-c7e6-4f19-8b64-9b89129ab761 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:57.439455 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ec3fac5d-1e50-4ce8-8403-b1803371fff2 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1362 microversion: 2.1 time: 0.240828 May 26 15:09:57.440077 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 99/230] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:57 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1362 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:57.444655 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-11a18adc-6662-4cea-b5fd-6a95e57831e8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:57.445282 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-11a18adc-6662-4cea-b5fd-6a95e57831e8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:57.452659 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-11a18adc-6662-4cea-b5fd-6a95e57831e8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:57.453206 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-11a18adc-6662-4cea-b5fd-6a95e57831e8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:57.454047 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-11a18adc-6662-4cea-b5fd-6a95e57831e8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:57.454483 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-11a18adc-6662-4cea-b5fd-6a95e57831e8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:57.454622 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-a8d972b2-c7e6-4f19-8b64-9b89129ab761 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:57.456257 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-a8d972b2-c7e6-4f19-8b64-9b89129ab761 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:57.457462 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-a8d972b2-c7e6-4f19-8b64-9b89129ab761 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1406 microversion: 2.20 time: 0.243386 May 26 15:09:57.458022 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 132/231] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:09:57 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1406 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:09:57.462509 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-635fb159-dc59-47d5-b040-c0f1078179f7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:57.463289 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-635fb159-dc59-47d5-b040-c0f1078179f7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:57.471621 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-635fb159-dc59-47d5-b040-c0f1078179f7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:57.472069 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-635fb159-dc59-47d5-b040-c0f1078179f7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:57.472895 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-635fb159-dc59-47d5-b040-c0f1078179f7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:57.473378 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-635fb159-dc59-47d5-b040-c0f1078179f7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:57.686819 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-11a18adc-6662-4cea-b5fd-6a95e57831e8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:57.690019 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-635fb159-dc59-47d5-b040-c0f1078179f7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:57.699165 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-11a18adc-6662-4cea-b5fd-6a95e57831e8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1521 microversion: 2.1 time: 0.257946 May 26 15:09:57.700859 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 100/232] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:57 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:57.702748 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-635fb159-dc59-47d5-b040-c0f1078179f7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1367 microversion: 2.1 time: 0.242903 May 26 15:09:57.703542 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 133/233] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:57 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:58.460833 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-61e95ece-f851-41ad-a6f5-71d1066943c6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:58.461708 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-61e95ece-f851-41ad-a6f5-71d1066943c6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:58.470412 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-61e95ece-f851-41ad-a6f5-71d1066943c6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:58.470900 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-61e95ece-f851-41ad-a6f5-71d1066943c6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:58.471838 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-61e95ece-f851-41ad-a6f5-71d1066943c6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:58.472294 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-61e95ece-f851-41ad-a6f5-71d1066943c6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:58.479312 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-87a3d581-e5e0-4599-8e08-0a60d2186db0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:58.480725 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-87a3d581-e5e0-4599-8e08-0a60d2186db0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:58.489382 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-87a3d581-e5e0-4599-8e08-0a60d2186db0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:58.490280 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-87a3d581-e5e0-4599-8e08-0a60d2186db0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:58.491371 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-87a3d581-e5e0-4599-8e08-0a60d2186db0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:58.491970 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-87a3d581-e5e0-4599-8e08-0a60d2186db0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:58.702560 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-61e95ece-f851-41ad-a6f5-71d1066943c6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:58.713091 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-61e95ece-f851-41ad-a6f5-71d1066943c6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1362 microversion: 2.1 time: 0.258108 May 26 15:09:58.713851 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 101/234] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:58 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1362 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:58.727764 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a7ca7555-7da8-4fb9-95e8-9f4b789ae9aa tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:58.731202 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-87a3d581-e5e0-4599-8e08-0a60d2186db0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:58.740286 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-87a3d581-e5e0-4599-8e08-0a60d2186db0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:58.741773 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-87a3d581-e5e0-4599-8e08-0a60d2186db0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:58.742877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-87a3d581-e5e0-4599-8e08-0a60d2186db0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1406 microversion: 2.20 time: 0.269083 May 26 15:09:58.743452 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 134/235] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:09:58 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1406 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:09:58.754681 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a7ca7555-7da8-4fb9-95e8-9f4b789ae9aa tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:58.767017 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a7ca7555-7da8-4fb9-95e8-9f4b789ae9aa tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:58.767491 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a7ca7555-7da8-4fb9-95e8-9f4b789ae9aa tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:58.768472 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a7ca7555-7da8-4fb9-95e8-9f4b789ae9aa tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:58.768933 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a7ca7555-7da8-4fb9-95e8-9f4b789ae9aa tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:58.772662 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-64dd8e99-87b5-4dce-9afa-e67152b58188 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:58.773891 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-64dd8e99-87b5-4dce-9afa-e67152b58188 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:58.800265 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-64dd8e99-87b5-4dce-9afa-e67152b58188 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:58.800763 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-64dd8e99-87b5-4dce-9afa-e67152b58188 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:58.801548 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-64dd8e99-87b5-4dce-9afa-e67152b58188 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:58.801988 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-64dd8e99-87b5-4dce-9afa-e67152b58188 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:59.013881 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a7ca7555-7da8-4fb9-95e8-9f4b789ae9aa tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:59.017883 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-64dd8e99-87b5-4dce-9afa-e67152b58188 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:59.030707 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-64dd8e99-87b5-4dce-9afa-e67152b58188 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1367 microversion: 2.1 time: 0.269102 May 26 15:09:59.031108 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a7ca7555-7da8-4fb9-95e8-9f4b789ae9aa tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1521 microversion: 2.1 time: 0.306901 May 26 15:09:59.031763 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 135/236] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:58 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1367 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:59.031976 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 102/237] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:58 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:59.519027 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-0943f862-ea5c-4ad2-bb40-59f93cc66a84 req-f328c403-80b1-4fc0-a220-139175cec845 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f969f1fa-bb13-4b63-9095-0881db5202df", "name": "network-vif-plugged", "status": "completed", "tag": "e5676082-5402-41ae-be68-6d928c3d3d18"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:59.550000 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-0943f862-ea5c-4ad2-bb40-59f93cc66a84 req-f328c403-80b1-4fc0-a220-139175cec845 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:59.551329 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-0943f862-ea5c-4ad2-bb40-59f93cc66a84 req-f328c403-80b1-4fc0-a220-139175cec845 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:59.584111 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-0943f862-ea5c-4ad2-bb40-59f93cc66a84 req-f328c403-80b1-4fc0-a220-139175cec845 service nova] Creating event network-vif-plugged:e5676082-5402-41ae-be68-6d928c3d3d18 for instance f969f1fa-bb13-4b63-9095-0881db5202df on hv-cinder-84301 May 26 15:09:59.591851 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-0943f862-ea5c-4ad2-bb40-59f93cc66a84 req-f328c403-80b1-4fc0-a220-139175cec845 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078579 May 26 15:09:59.594612 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 136/238] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:09:59.731917 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-2bcce93f-b5bd-447a-99b3-4823fb4716ab tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:59.732729 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-2bcce93f-b5bd-447a-99b3-4823fb4716ab tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:59.748435 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2bcce93f-b5bd-447a-99b3-4823fb4716ab tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:59.750807 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2bcce93f-b5bd-447a-99b3-4823fb4716ab tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:59.754918 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2bcce93f-b5bd-447a-99b3-4823fb4716ab tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:59.754918 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2bcce93f-b5bd-447a-99b3-4823fb4716ab tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:59.763012 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-5c495c91-bc2c-48cd-9095-54d1fbb799dc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:59.763665 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-5c495c91-bc2c-48cd-9095-54d1fbb799dc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:59.778486 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5c495c91-bc2c-48cd-9095-54d1fbb799dc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:59.780377 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5c495c91-bc2c-48cd-9095-54d1fbb799dc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:59.781731 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5c495c91-bc2c-48cd-9095-54d1fbb799dc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:59.782250 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5c495c91-bc2c-48cd-9095-54d1fbb799dc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:00.078127 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-5c495c91-bc2c-48cd-9095-54d1fbb799dc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:00.087022 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-5c495c91-bc2c-48cd-9095-54d1fbb799dc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:00.088870 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-5c495c91-bc2c-48cd-9095-54d1fbb799dc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:00.090250 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-5c495c91-bc2c-48cd-9095-54d1fbb799dc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1406 microversion: 2.20 time: 0.331738 May 26 15:10:00.091221 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 137/239] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:09:59 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1406 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:10:00.092257 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2bcce93f-b5bd-447a-99b3-4823fb4716ab tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:00.096668 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-bdb15298-bcec-4ad6-8cf8-c6d104e9962d tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:00.097570 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-bdb15298-bcec-4ad6-8cf8-c6d104e9962d tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:00.103487 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-2bcce93f-b5bd-447a-99b3-4823fb4716ab tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1549 microversion: 2.1 time: 0.373767 May 26 15:10:00.115121 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 103/240] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:09:59 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1549 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:00.115121 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1a72f14b-2eba-41e6-9bb5-a4ef25e7a6ed tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:00.115121 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1a72f14b-2eba-41e6-9bb5-a4ef25e7a6ed tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:00.117142 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-bdb15298-bcec-4ad6-8cf8-c6d104e9962d tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:00.117775 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-bdb15298-bcec-4ad6-8cf8-c6d104e9962d tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:00.118682 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-bdb15298-bcec-4ad6-8cf8-c6d104e9962d tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:00.119151 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-bdb15298-bcec-4ad6-8cf8-c6d104e9962d tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:00.120005 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1a72f14b-2eba-41e6-9bb5-a4ef25e7a6ed tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:00.120502 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1a72f14b-2eba-41e6-9bb5-a4ef25e7a6ed tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:00.121571 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1a72f14b-2eba-41e6-9bb5-a4ef25e7a6ed tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:00.122213 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1a72f14b-2eba-41e6-9bb5-a4ef25e7a6ed tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:00.383397 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-bdb15298-bcec-4ad6-8cf8-c6d104e9962d tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:00.396980 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1a72f14b-2eba-41e6-9bb5-a4ef25e7a6ed tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:00.397696 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-bdb15298-bcec-4ad6-8cf8-c6d104e9962d tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1367 microversion: 2.1 time: 0.304616 May 26 15:10:00.399114 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 138/241] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:00 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1367 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:00.405719 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1a72f14b-2eba-41e6-9bb5-a4ef25e7a6ed tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1521 microversion: 2.1 time: 0.299886 May 26 15:10:00.407731 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 104/242] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:00 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:00.420107 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-7a15907d-9c45-45d9-a053-71baaa60b93e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:00.421334 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-7a15907d-9c45-45d9-a053-71baaa60b93e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:00.431422 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7a15907d-9c45-45d9-a053-71baaa60b93e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:00.432662 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7a15907d-9c45-45d9-a053-71baaa60b93e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:00.434077 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7a15907d-9c45-45d9-a053-71baaa60b93e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:00.434700 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7a15907d-9c45-45d9-a053-71baaa60b93e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:00.538321 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-7a15907d-9c45-45d9-a053-71baaa60b93e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.136503 May 26 15:10:00.539002 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 139/243] 10.222.0.45 () {58 vars in 1274 bytes} [Thu May 26 15:10:00 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c/os-interface => generated 285 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:10:01.111597 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a2926e48-fd38-442e-ad33-756f24bd4217 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:01.112265 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a2926e48-fd38-442e-ad33-756f24bd4217 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:01.119130 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a2926e48-fd38-442e-ad33-756f24bd4217 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:01.119939 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a2926e48-fd38-442e-ad33-756f24bd4217 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:01.120823 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a2926e48-fd38-442e-ad33-756f24bd4217 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:01.121320 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a2926e48-fd38-442e-ad33-756f24bd4217 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:01.317503 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a2926e48-fd38-442e-ad33-756f24bd4217 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:01.332225 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a2926e48-fd38-442e-ad33-756f24bd4217 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:01.334125 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a2926e48-fd38-442e-ad33-756f24bd4217 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:01.335768 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a2926e48-fd38-442e-ad33-756f24bd4217 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1406 microversion: 2.20 time: 0.229333 May 26 15:10:01.336442 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 105/244] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:10:01 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:10:01.424282 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-bac747a2-b3c4-4c83-a81c-3d9bf0c5cc55 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:01.425231 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-bac747a2-b3c4-4c83-a81c-3d9bf0c5cc55 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:01.429255 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-9dd9281c-b064-4bfc-9ff9-eb381cab7782 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:01.429924 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-9dd9281c-b064-4bfc-9ff9-eb381cab7782 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:01.437910 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9dd9281c-b064-4bfc-9ff9-eb381cab7782 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:01.438398 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9dd9281c-b064-4bfc-9ff9-eb381cab7782 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:01.439864 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9dd9281c-b064-4bfc-9ff9-eb381cab7782 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:01.440374 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-bac747a2-b3c4-4c83-a81c-3d9bf0c5cc55 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:01.440677 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9dd9281c-b064-4bfc-9ff9-eb381cab7782 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:01.441060 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-bac747a2-b3c4-4c83-a81c-3d9bf0c5cc55 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:01.442761 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-bac747a2-b3c4-4c83-a81c-3d9bf0c5cc55 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:01.444830 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-bac747a2-b3c4-4c83-a81c-3d9bf0c5cc55 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:01.490008 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:01.834693 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-bac747a2-b3c4-4c83-a81c-3d9bf0c5cc55 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:01.844248 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-bac747a2-b3c4-4c83-a81c-3d9bf0c5cc55 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1367 microversion: 2.1 time: 0.430944 May 26 15:10:01.844858 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 140/245] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:01 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1367 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:01.870783 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-9dd9281c-b064-4bfc-9ff9-eb381cab7782 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:01.880466 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-9dd9281c-b064-4bfc-9ff9-eb381cab7782 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1521 microversion: 2.1 time: 0.456242 May 26 15:10:01.881090 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 106/246] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:01 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1521 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:02.354763 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-65dbf61e-a708-41d5-a770-d1686dbca8ff tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:02.355411 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-65dbf61e-a708-41d5-a770-d1686dbca8ff tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:02.363745 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-65dbf61e-a708-41d5-a770-d1686dbca8ff tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:02.364655 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-65dbf61e-a708-41d5-a770-d1686dbca8ff tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:02.365685 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-65dbf61e-a708-41d5-a770-d1686dbca8ff tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:02.366503 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-65dbf61e-a708-41d5-a770-d1686dbca8ff tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:02.583030 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-65dbf61e-a708-41d5-a770-d1686dbca8ff tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:02.597888 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-65dbf61e-a708-41d5-a770-d1686dbca8ff tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:02.601102 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-65dbf61e-a708-41d5-a770-d1686dbca8ff tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:02.604798 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-65dbf61e-a708-41d5-a770-d1686dbca8ff tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1598 microversion: 2.20 time: 0.254834 May 26 15:10:02.607552 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 141/247] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:10:02 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1598 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:10:02.630326 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b0dcddf1-b8ae-4d09-acd7-7813eb5c8b11 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:02.631049 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b0dcddf1-b8ae-4d09-acd7-7813eb5c8b11 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:02.640501 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b0dcddf1-b8ae-4d09-acd7-7813eb5c8b11 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:02.641150 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b0dcddf1-b8ae-4d09-acd7-7813eb5c8b11 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:02.642190 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b0dcddf1-b8ae-4d09-acd7-7813eb5c8b11 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:02.642873 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b0dcddf1-b8ae-4d09-acd7-7813eb5c8b11 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:02.675483 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-cbbaa832-ccb9-49d6-9460-d00efe6232a6 req-e58c52d1-1861-4257-88c9-249974923318 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29d9c670-e34a-4363-9e60-745335a3ea6c", "tag": "594748ba-cf8f-4cb8-bfc4-dba073613057"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:10:02.690174 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-cbbaa832-ccb9-49d6-9460-d00efe6232a6 req-e58c52d1-1861-4257-88c9-249974923318 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:02.696375 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-cbbaa832-ccb9-49d6-9460-d00efe6232a6 req-e58c52d1-1861-4257-88c9-249974923318 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:02.714595 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-cbbaa832-ccb9-49d6-9460-d00efe6232a6 req-e58c52d1-1861-4257-88c9-249974923318 service nova] Creating event network-changed:594748ba-cf8f-4cb8-bfc4-dba073613057 for instance 29d9c670-e34a-4363-9e60-745335a3ea6c on hv-cinder-84301 May 26 15:10:02.721792 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-cbbaa832-ccb9-49d6-9460-d00efe6232a6 req-e58c52d1-1861-4257-88c9-249974923318 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049777 May 26 15:10:02.722700 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 142/248] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:10:02.771050 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b0dcddf1-b8ae-4d09-acd7-7813eb5c8b11 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.148770 May 26 15:10:02.773624 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 107/249] 10.222.0.45 () {60 vars in 1315 bytes} [Thu May 26 15:10:02 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6/os-interface => generated 284 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:10:02.871339 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-a821c917-9e47-4be7-bd33-914bf7062df8 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:02.872736 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-a821c917-9e47-4be7-bd33-914bf7062df8 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:02.884900 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a821c917-9e47-4be7-bd33-914bf7062df8 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:02.885731 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a821c917-9e47-4be7-bd33-914bf7062df8 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:02.886733 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a821c917-9e47-4be7-bd33-914bf7062df8 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:02.887413 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a821c917-9e47-4be7-bd33-914bf7062df8 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:02.898628 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-46b4971c-5ac7-46d5-9572-b0df9f9bfcf2 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:02.899668 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-46b4971c-5ac7-46d5-9572-b0df9f9bfcf2 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:02.913741 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-46b4971c-5ac7-46d5-9572-b0df9f9bfcf2 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:02.914181 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-46b4971c-5ac7-46d5-9572-b0df9f9bfcf2 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:02.914970 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-46b4971c-5ac7-46d5-9572-b0df9f9bfcf2 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:02.919665 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-46b4971c-5ac7-46d5-9572-b0df9f9bfcf2 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:03.560207 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-46b4971c-5ac7-46d5-9572-b0df9f9bfcf2 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:03.572785 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-46b4971c-5ac7-46d5-9572-b0df9f9bfcf2 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1521 microversion: 2.1 time: 0.678543 May 26 15:10:03.582549 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-a821c917-9e47-4be7-bd33-914bf7062df8 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:03.587821 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 108/250] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:02 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1521 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:03.596483 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-a821c917-9e47-4be7-bd33-914bf7062df8 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1367 microversion: 2.1 time: 0.727374 May 26 15:10:03.598554 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 143/251] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:02 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1367 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:04.592305 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-66aff28c-c441-4d63-8668-0d473b16f4b3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:04.593932 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-66aff28c-c441-4d63-8668-0d473b16f4b3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:04.600745 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-66aff28c-c441-4d63-8668-0d473b16f4b3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:04.601515 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-66aff28c-c441-4d63-8668-0d473b16f4b3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:04.602900 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-66aff28c-c441-4d63-8668-0d473b16f4b3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:04.603576 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-66aff28c-c441-4d63-8668-0d473b16f4b3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:04.617386 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-43fbd03f-77c1-4965-8afb-3c94e38c426d tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:04.618062 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-43fbd03f-77c1-4965-8afb-3c94e38c426d tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:04.626082 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-43fbd03f-77c1-4965-8afb-3c94e38c426d tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:04.626916 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-43fbd03f-77c1-4965-8afb-3c94e38c426d tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:04.628066 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-43fbd03f-77c1-4965-8afb-3c94e38c426d tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:04.628706 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-43fbd03f-77c1-4965-8afb-3c94e38c426d tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:04.924175 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-43fbd03f-77c1-4965-8afb-3c94e38c426d tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:04.934274 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-43fbd03f-77c1-4965-8afb-3c94e38c426d tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1367 microversion: 2.1 time: 0.321962 May 26 15:10:04.935316 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 144/252] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:04 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1367 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:10:04.935788 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-66aff28c-c441-4d63-8668-0d473b16f4b3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:04.945357 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-66aff28c-c441-4d63-8668-0d473b16f4b3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1521 microversion: 2.1 time: 0.356869 May 26 15:10:04.945950 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 109/253] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:04 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1521 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:05.104370 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-5c3ae0e7-5546-494a-8680-7e25d27afe6c req-03aada20-b2b0-4a49-8b17-303ec0b11ac3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6", "tag": "6342ec5c-6f4f-42ae-aaeb-2f79c05fef02"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:10:05.112751 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-5c3ae0e7-5546-494a-8680-7e25d27afe6c req-03aada20-b2b0-4a49-8b17-303ec0b11ac3 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:05.113466 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-5c3ae0e7-5546-494a-8680-7e25d27afe6c req-03aada20-b2b0-4a49-8b17-303ec0b11ac3 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:05.125771 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-5c3ae0e7-5546-494a-8680-7e25d27afe6c req-03aada20-b2b0-4a49-8b17-303ec0b11ac3 service nova] Creating event network-changed:6342ec5c-6f4f-42ae-aaeb-2f79c05fef02 for instance 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 on hv-cinder-84301 May 26 15:10:05.130984 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-5c3ae0e7-5546-494a-8680-7e25d27afe6c req-03aada20-b2b0-4a49-8b17-303ec0b11ac3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030280 May 26 15:10:05.131940 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 145/254] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:10:05.953192 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1f426590-b3d2-4abe-b845-33825d7708d0 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:05.954646 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1f426590-b3d2-4abe-b845-33825d7708d0 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:05.965954 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-b0cf3f77-ab07-42bd-9ea9-24362b537c27 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:05.968284 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-b0cf3f77-ab07-42bd-9ea9-24362b537c27 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:05.969389 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1f426590-b3d2-4abe-b845-33825d7708d0 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:05.970069 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1f426590-b3d2-4abe-b845-33825d7708d0 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:05.971369 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1f426590-b3d2-4abe-b845-33825d7708d0 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:05.971932 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1f426590-b3d2-4abe-b845-33825d7708d0 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:05.976740 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b0cf3f77-ab07-42bd-9ea9-24362b537c27 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:05.977440 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b0cf3f77-ab07-42bd-9ea9-24362b537c27 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:05.978504 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b0cf3f77-ab07-42bd-9ea9-24362b537c27 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:05.979328 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b0cf3f77-ab07-42bd-9ea9-24362b537c27 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:06.256836 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1f426590-b3d2-4abe-b845-33825d7708d0 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:06.272109 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1f426590-b3d2-4abe-b845-33825d7708d0 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1557 microversion: 2.1 time: 0.324274 May 26 15:10:06.276172 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 110/255] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:05 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1557 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:06.290861 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-b0cf3f77-ab07-42bd-9ea9-24362b537c27 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:06.300279 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-b0cf3f77-ab07-42bd-9ea9-24362b537c27 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1521 microversion: 2.1 time: 0.340696 May 26 15:10:06.300967 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-701a8fcd-31c1-4422-be2f-7319d965c352 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:06.302381 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-701a8fcd-31c1-4422-be2f-7319d965c352 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:06.312566 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-701a8fcd-31c1-4422-be2f-7319d965c352 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:06.313386 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-701a8fcd-31c1-4422-be2f-7319d965c352 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:06.313704 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 146/256] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:05 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1521 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:06.314991 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-701a8fcd-31c1-4422-be2f-7319d965c352 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:06.320404 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-701a8fcd-31c1-4422-be2f-7319d965c352 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:06.325130 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=100 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:06.431808 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-701a8fcd-31c1-4422-be2f-7319d965c352 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.137718 May 26 15:10:06.432667 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 111/257] 10.222.0.45 () {58 vars in 1274 bytes} [Thu May 26 15:10:06 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df/os-interface => generated 284 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:10:07.316968 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-964ab4a9-3e61-4726-b51b-0d5f9419cf27 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:07.317581 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-964ab4a9-3e61-4726-b51b-0d5f9419cf27 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:07.323719 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-964ab4a9-3e61-4726-b51b-0d5f9419cf27 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:07.324172 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-964ab4a9-3e61-4726-b51b-0d5f9419cf27 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:07.324939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-964ab4a9-3e61-4726-b51b-0d5f9419cf27 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:07.325375 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-964ab4a9-3e61-4726-b51b-0d5f9419cf27 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:07.541463 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-964ab4a9-3e61-4726-b51b-0d5f9419cf27 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:07.549411 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-964ab4a9-3e61-4726-b51b-0d5f9419cf27 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1521 microversion: 2.1 time: 0.236289 May 26 15:10:07.549989 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 147/258] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:07 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:07.599169 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-92072fd5-bafb-482c-b3bd-2af60654668e req-a94949a2-ba9a-4fb2-94ab-87542ce9885f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f969f1fa-bb13-4b63-9095-0881db5202df", "tag": "e5676082-5402-41ae-be68-6d928c3d3d18"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:10:07.607413 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-92072fd5-bafb-482c-b3bd-2af60654668e req-a94949a2-ba9a-4fb2-94ab-87542ce9885f service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:07.608992 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-92072fd5-bafb-482c-b3bd-2af60654668e req-a94949a2-ba9a-4fb2-94ab-87542ce9885f service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:07.621811 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-92072fd5-bafb-482c-b3bd-2af60654668e req-a94949a2-ba9a-4fb2-94ab-87542ce9885f service nova] Creating event network-changed:e5676082-5402-41ae-be68-6d928c3d3d18 for instance f969f1fa-bb13-4b63-9095-0881db5202df on hv-cinder-84301 May 26 15:10:07.628375 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-92072fd5-bafb-482c-b3bd-2af60654668e req-a94949a2-ba9a-4fb2-94ab-87542ce9885f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033425 May 26 15:10:07.628970 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 112/259] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:10:08.567076 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-7349fd9f-1078-49df-9822-2c76ae87fd6a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:08.567701 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-7349fd9f-1078-49df-9822-2c76ae87fd6a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:08.573732 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7349fd9f-1078-49df-9822-2c76ae87fd6a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:08.574173 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7349fd9f-1078-49df-9822-2c76ae87fd6a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:08.574929 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7349fd9f-1078-49df-9822-2c76ae87fd6a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:08.575379 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7349fd9f-1078-49df-9822-2c76ae87fd6a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:08.721376 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-7349fd9f-1078-49df-9822-2c76ae87fd6a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:08.729387 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-7349fd9f-1078-49df-9822-2c76ae87fd6a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1521 microversion: 2.1 time: 0.166087 May 26 15:10:08.729966 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 148/260] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:08 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:09.747927 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-58f0017c-70da-405c-ac19-ad1bb4f4bfa5 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:09.749204 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-58f0017c-70da-405c-ac19-ad1bb4f4bfa5 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:09.755419 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-58f0017c-70da-405c-ac19-ad1bb4f4bfa5 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:09.755866 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-58f0017c-70da-405c-ac19-ad1bb4f4bfa5 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:09.756618 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-58f0017c-70da-405c-ac19-ad1bb4f4bfa5 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:09.757048 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-58f0017c-70da-405c-ac19-ad1bb4f4bfa5 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:09.899761 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-58f0017c-70da-405c-ac19-ad1bb4f4bfa5 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:09.907456 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-58f0017c-70da-405c-ac19-ad1bb4f4bfa5 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1521 microversion: 2.1 time: 0.164243 May 26 15:10:09.908030 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 113/261] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:09 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:10.926626 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-0c052554-9a64-4b02-a87f-610a1b988c8d tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:10.927565 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-0c052554-9a64-4b02-a87f-610a1b988c8d tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:10.935762 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0c052554-9a64-4b02-a87f-610a1b988c8d tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:10.936958 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0c052554-9a64-4b02-a87f-610a1b988c8d tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:10.937789 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0c052554-9a64-4b02-a87f-610a1b988c8d tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:10.938220 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0c052554-9a64-4b02-a87f-610a1b988c8d tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:11.082828 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-0c052554-9a64-4b02-a87f-610a1b988c8d tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:11.090967 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-0c052554-9a64-4b02-a87f-610a1b988c8d tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1521 microversion: 2.1 time: 0.170403 May 26 15:10:11.091575 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 149/262] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:10 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:12.111108 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-0434afe7-41c7-4859-82c1-b68c9dc0cfe0 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:12.111916 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-0434afe7-41c7-4859-82c1-b68c9dc0cfe0 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:12.119243 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0434afe7-41c7-4859-82c1-b68c9dc0cfe0 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:12.119694 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0434afe7-41c7-4859-82c1-b68c9dc0cfe0 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:12.120465 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0434afe7-41c7-4859-82c1-b68c9dc0cfe0 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:12.120898 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0434afe7-41c7-4859-82c1-b68c9dc0cfe0 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:12.268960 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-0434afe7-41c7-4859-82c1-b68c9dc0cfe0 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:12.277632 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-0434afe7-41c7-4859-82c1-b68c9dc0cfe0 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1521 microversion: 2.1 time: 0.172517 May 26 15:10:12.278503 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 114/263] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:12 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:13.298363 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-80267b1a-6bc4-4010-b00a-3df756aa9a30 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:13.299103 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-80267b1a-6bc4-4010-b00a-3df756aa9a30 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:13.309209 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-80267b1a-6bc4-4010-b00a-3df756aa9a30 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:13.309796 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-80267b1a-6bc4-4010-b00a-3df756aa9a30 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:13.311166 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-80267b1a-6bc4-4010-b00a-3df756aa9a30 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:13.312090 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-80267b1a-6bc4-4010-b00a-3df756aa9a30 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:13.506192 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-80267b1a-6bc4-4010-b00a-3df756aa9a30 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:13.516548 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-80267b1a-6bc4-4010-b00a-3df756aa9a30 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1521 microversion: 2.1 time: 0.223684 May 26 15:10:13.528206 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 150/264] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:13 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:10:13.574291 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-3ace1912-bdcd-4279-bf6e-4a0673050c5f tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:13.575477 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-3ace1912-bdcd-4279-bf6e-4a0673050c5f tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:13.583000 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3ace1912-bdcd-4279-bf6e-4a0673050c5f tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:13.583481 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3ace1912-bdcd-4279-bf6e-4a0673050c5f tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:13.584504 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3ace1912-bdcd-4279-bf6e-4a0673050c5f tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:13.585127 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3ace1912-bdcd-4279-bf6e-4a0673050c5f tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:13.616358 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-3ace1912-bdcd-4279-bf6e-4a0673050c5f tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Going to try to terminate instance {{(pid=117798) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:10:13.721427 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-3ace1912-bdcd-4279-bf6e-4a0673050c5f tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 204 len: 0 microversion: 2.1 time: 0.151403 May 26 15:10:13.721998 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 115/265] 10.222.0.45 () {58 vars in 1238 bytes} [Thu May 26 15:10:13 2022] DELETE /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:10:13.729888 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-b45521c6-a771-4164-b6af-1898ed791fe3 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:13.730430 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-b45521c6-a771-4164-b6af-1898ed791fe3 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:13.737180 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b45521c6-a771-4164-b6af-1898ed791fe3 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:13.737629 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b45521c6-a771-4164-b6af-1898ed791fe3 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:13.738390 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b45521c6-a771-4164-b6af-1898ed791fe3 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:13.738818 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b45521c6-a771-4164-b6af-1898ed791fe3 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:13.913791 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-b45521c6-a771-4164-b6af-1898ed791fe3 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a1284bc044e51923c72a9f8f41d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39490fef872043d1bfef791dd0bbb5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:13.923205 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-b45521c6-a771-4164-b6af-1898ed791fe3 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 200 len: 1552 microversion: 2.1 time: 0.196686 May 26 15:10:13.923791 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 151/266] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:13 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 1552 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:14.537940 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-441ce72d-a18f-4740-bb23-0d5c774053a4 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:14.538627 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-441ce72d-a18f-4740-bb23-0d5c774053a4 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:14.547593 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-441ce72d-a18f-4740-bb23-0d5c774053a4 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:14.548093 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-441ce72d-a18f-4740-bb23-0d5c774053a4 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:14.548929 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-441ce72d-a18f-4740-bb23-0d5c774053a4 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:14.549474 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-441ce72d-a18f-4740-bb23-0d5c774053a4 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:14.699414 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-441ce72d-a18f-4740-bb23-0d5c774053a4 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:14.708856 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-441ce72d-a18f-4740-bb23-0d5c774053a4 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1521 microversion: 2.1 time: 0.175151 May 26 15:10:14.709441 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 116/267] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:14 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:14.942722 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-d724106b-288e-40fa-bbc7-51d8ea5828f2 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:14.943971 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-d724106b-288e-40fa-bbc7-51d8ea5828f2 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:14.950593 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d724106b-288e-40fa-bbc7-51d8ea5828f2 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:14.951069 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d724106b-288e-40fa-bbc7-51d8ea5828f2 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:14.952040 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d724106b-288e-40fa-bbc7-51d8ea5828f2 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:14.952484 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d724106b-288e-40fa-bbc7-51d8ea5828f2 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:15.112984 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-d724106b-288e-40fa-bbc7-51d8ea5828f2 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a1284bc044e51923c72a9f8f41d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39490fef872043d1bfef791dd0bbb5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:15.121159 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-d724106b-288e-40fa-bbc7-51d8ea5828f2 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 200 len: 1552 microversion: 2.1 time: 0.183112 May 26 15:10:15.121748 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 152/268] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:14 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 1552 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:15.725810 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-77814bc6-3a92-4a7f-b222-27a23b702fbf tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:15.726414 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-77814bc6-3a92-4a7f-b222-27a23b702fbf tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:15.733325 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-77814bc6-3a92-4a7f-b222-27a23b702fbf tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:15.734339 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-77814bc6-3a92-4a7f-b222-27a23b702fbf tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:15.735253 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-77814bc6-3a92-4a7f-b222-27a23b702fbf tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:15.735714 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-77814bc6-3a92-4a7f-b222-27a23b702fbf tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:15.877048 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-77814bc6-3a92-4a7f-b222-27a23b702fbf tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:15.886342 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-77814bc6-3a92-4a7f-b222-27a23b702fbf tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1521 microversion: 2.1 time: 0.164401 May 26 15:10:15.886926 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 117/269] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:15 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:16.140184 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-5e847458-ab97-4e20-9303-3f312b7236f7 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:16.140905 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-5e847458-ab97-4e20-9303-3f312b7236f7 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:16.147338 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5e847458-ab97-4e20-9303-3f312b7236f7 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:16.147779 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5e847458-ab97-4e20-9303-3f312b7236f7 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:16.148787 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5e847458-ab97-4e20-9303-3f312b7236f7 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:16.149212 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5e847458-ab97-4e20-9303-3f312b7236f7 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:16.303448 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-5e847458-ab97-4e20-9303-3f312b7236f7 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a1284bc044e51923c72a9f8f41d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39490fef872043d1bfef791dd0bbb5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:16.313299 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-5e847458-ab97-4e20-9303-3f312b7236f7 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 200 len: 1552 microversion: 2.1 time: 0.177338 May 26 15:10:16.314108 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 153/270] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:16 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 1552 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:10:16.906082 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-2f393469-8b0b-4fe3-8afb-f7ef4f4e7df2 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:16.906737 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-2f393469-8b0b-4fe3-8afb-f7ef4f4e7df2 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:16.914152 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2f393469-8b0b-4fe3-8afb-f7ef4f4e7df2 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:16.914673 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2f393469-8b0b-4fe3-8afb-f7ef4f4e7df2 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:16.915512 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2f393469-8b0b-4fe3-8afb-f7ef4f4e7df2 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:16.916034 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2f393469-8b0b-4fe3-8afb-f7ef4f4e7df2 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:17.058689 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2f393469-8b0b-4fe3-8afb-f7ef4f4e7df2 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:17.067210 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-2f393469-8b0b-4fe3-8afb-f7ef4f4e7df2 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1521 microversion: 2.1 time: 0.166229 May 26 15:10:17.067864 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 118/271] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:16 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:17.331597 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-dab73724-c553-4da4-9c6c-0f6150f6c494 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:17.332334 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-dab73724-c553-4da4-9c6c-0f6150f6c494 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:17.338819 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dab73724-c553-4da4-9c6c-0f6150f6c494 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:17.339298 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dab73724-c553-4da4-9c6c-0f6150f6c494 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:17.340067 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dab73724-c553-4da4-9c6c-0f6150f6c494 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:17.340501 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dab73724-c553-4da4-9c6c-0f6150f6c494 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:17.492025 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-dab73724-c553-4da4-9c6c-0f6150f6c494 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a1284bc044e51923c72a9f8f41d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39490fef872043d1bfef791dd0bbb5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:17.501508 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-dab73724-c553-4da4-9c6c-0f6150f6c494 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 200 len: 1552 microversion: 2.1 time: 0.174366 May 26 15:10:17.502136 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 154/272] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:17 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 1552 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:18.085248 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-143349f6-ebe6-4848-b9be-253f573b6ce7 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:18.086971 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-143349f6-ebe6-4848-b9be-253f573b6ce7 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:18.095743 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-143349f6-ebe6-4848-b9be-253f573b6ce7 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:18.096189 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-143349f6-ebe6-4848-b9be-253f573b6ce7 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:18.097050 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-143349f6-ebe6-4848-b9be-253f573b6ce7 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:18.097573 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-143349f6-ebe6-4848-b9be-253f573b6ce7 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:18.252317 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-143349f6-ebe6-4848-b9be-253f573b6ce7 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:18.260518 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-143349f6-ebe6-4848-b9be-253f573b6ce7 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1521 microversion: 2.1 time: 0.179839 May 26 15:10:18.261104 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 119/273] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:18 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:18.520068 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-7b2eb2f4-d636-44ce-b853-7bfc2bf24ec6 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:18.520706 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-7b2eb2f4-d636-44ce-b853-7bfc2bf24ec6 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:18.527027 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7b2eb2f4-d636-44ce-b853-7bfc2bf24ec6 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:18.527514 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7b2eb2f4-d636-44ce-b853-7bfc2bf24ec6 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:18.528468 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7b2eb2f4-d636-44ce-b853-7bfc2bf24ec6 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:18.528906 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7b2eb2f4-d636-44ce-b853-7bfc2bf24ec6 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:18.675559 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-7b2eb2f4-d636-44ce-b853-7bfc2bf24ec6 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a1284bc044e51923c72a9f8f41d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39490fef872043d1bfef791dd0bbb5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:18.683599 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-7b2eb2f4-d636-44ce-b853-7bfc2bf24ec6 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 200 len: 1552 microversion: 2.1 time: 0.168562 May 26 15:10:18.684317 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 155/274] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:18 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 1552 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:19.279421 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a0f54d19-1e4e-47f5-a5fb-4f4e05aaab4a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:19.280031 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a0f54d19-1e4e-47f5-a5fb-4f4e05aaab4a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:19.288819 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a0f54d19-1e4e-47f5-a5fb-4f4e05aaab4a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:19.289465 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a0f54d19-1e4e-47f5-a5fb-4f4e05aaab4a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:19.290379 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a0f54d19-1e4e-47f5-a5fb-4f4e05aaab4a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:19.290852 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a0f54d19-1e4e-47f5-a5fb-4f4e05aaab4a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:19.665208 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a0f54d19-1e4e-47f5-a5fb-4f4e05aaab4a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:19.674639 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a0f54d19-1e4e-47f5-a5fb-4f4e05aaab4a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1521 microversion: 2.1 time: 0.399525 May 26 15:10:19.675335 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 120/275] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:19 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1521 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:19.703924 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-14dd94c4-ab82-4138-9577-f0e4333cc929 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:19.704582 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-14dd94c4-ab82-4138-9577-f0e4333cc929 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:19.710783 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-14dd94c4-ab82-4138-9577-f0e4333cc929 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:19.711273 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-14dd94c4-ab82-4138-9577-f0e4333cc929 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:19.712042 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-14dd94c4-ab82-4138-9577-f0e4333cc929 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:19.712483 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-14dd94c4-ab82-4138-9577-f0e4333cc929 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:19.855346 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-14dd94c4-ab82-4138-9577-f0e4333cc929 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a1284bc044e51923c72a9f8f41d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39490fef872043d1bfef791dd0bbb5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:19.866240 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-14dd94c4-ab82-4138-9577-f0e4333cc929 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 200 len: 1552 microversion: 2.1 time: 0.166865 May 26 15:10:19.866908 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 156/276] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:19 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 1552 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:20.695161 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-955c51f5-557c-4a06-bae7-3acd1242fa55 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:20.696529 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-955c51f5-557c-4a06-bae7-3acd1242fa55 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:20.706620 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-955c51f5-557c-4a06-bae7-3acd1242fa55 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:20.707075 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-955c51f5-557c-4a06-bae7-3acd1242fa55 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:20.707901 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-955c51f5-557c-4a06-bae7-3acd1242fa55 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:20.708336 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-955c51f5-557c-4a06-bae7-3acd1242fa55 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:20.864465 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-955c51f5-557c-4a06-bae7-3acd1242fa55 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:20.874978 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-955c51f5-557c-4a06-bae7-3acd1242fa55 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1521 microversion: 2.1 time: 0.183978 May 26 15:10:20.875906 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 121/277] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:20 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:20.885809 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-75991e92-fae5-49e3-b14c-c6fb4248f156 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:20.886579 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-75991e92-fae5-49e3-b14c-c6fb4248f156 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:20.894059 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-75991e92-fae5-49e3-b14c-c6fb4248f156 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:20.894855 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-75991e92-fae5-49e3-b14c-c6fb4248f156 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:20.895892 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-75991e92-fae5-49e3-b14c-c6fb4248f156 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:20.896524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-75991e92-fae5-49e3-b14c-c6fb4248f156 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:21.056382 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-75991e92-fae5-49e3-b14c-c6fb4248f156 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a1284bc044e51923c72a9f8f41d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39490fef872043d1bfef791dd0bbb5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:21.067658 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-75991e92-fae5-49e3-b14c-c6fb4248f156 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 200 len: 1552 microversion: 2.1 time: 0.185089 May 26 15:10:21.075921 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 157/278] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:20 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 1552 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:21.893383 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1543f70d-0f63-4f0b-9abc-213555337a5e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:21.894673 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1543f70d-0f63-4f0b-9abc-213555337a5e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:21.906029 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1543f70d-0f63-4f0b-9abc-213555337a5e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:21.906235 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1543f70d-0f63-4f0b-9abc-213555337a5e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:21.906927 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1543f70d-0f63-4f0b-9abc-213555337a5e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:21.908062 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1543f70d-0f63-4f0b-9abc-213555337a5e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:22.088562 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-ffaa6ce4-195f-42ad-9044-7b098c19b16f tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:22.089506 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-ffaa6ce4-195f-42ad-9044-7b098c19b16f tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:22.103241 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_api:SELECT=70 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:22.103241 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ffaa6ce4-195f-42ad-9044-7b098c19b16f tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:22.103241 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ffaa6ce4-195f-42ad-9044-7b098c19b16f tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:22.103241 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ffaa6ce4-195f-42ad-9044-7b098c19b16f tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:22.103536 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ffaa6ce4-195f-42ad-9044-7b098c19b16f tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:22.135137 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1543f70d-0f63-4f0b-9abc-213555337a5e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:22.141646 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=100 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:22.149865 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1543f70d-0f63-4f0b-9abc-213555337a5e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1521 microversion: 2.1 time: 0.260821 May 26 15:10:22.151243 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 122/279] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:21 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:22.296760 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-ffaa6ce4-195f-42ad-9044-7b098c19b16f tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a1284bc044e51923c72a9f8f41d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39490fef872043d1bfef791dd0bbb5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:22.306677 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-ffaa6ce4-195f-42ad-9044-7b098c19b16f tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 200 len: 1552 microversion: 2.1 time: 0.223907 May 26 15:10:22.308107 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 158/280] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:22 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 1552 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:22.319247 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-147adebe-b426-43a6-b9a5-f81b9d29b17f req-f0e4d10d-a30b-400d-b219-fd3996dd30aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8045b554-0891-4c2c-a842-76b806f8e817", "name": "network-vif-deleted", "tag": "e06f6e86-12f3-4048-8f36-e642cd36ea4a"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:10:22.330257 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-147adebe-b426-43a6-b9a5-f81b9d29b17f req-f0e4d10d-a30b-400d-b219-fd3996dd30aa service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:22.330706 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-147adebe-b426-43a6-b9a5-f81b9d29b17f req-f0e4d10d-a30b-400d-b219-fd3996dd30aa service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:22.343727 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-147adebe-b426-43a6-b9a5-f81b9d29b17f req-f0e4d10d-a30b-400d-b219-fd3996dd30aa service nova] Creating event network-vif-deleted:e06f6e86-12f3-4048-8f36-e642cd36ea4a for instance 8045b554-0891-4c2c-a842-76b806f8e817 on hv-cinder-84301 May 26 15:10:22.349129 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-147adebe-b426-43a6-b9a5-f81b9d29b17f req-f0e4d10d-a30b-400d-b219-fd3996dd30aa service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034208 May 26 15:10:22.349811 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 123/281] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:10:23.167968 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-7dcea6cd-d683-4c7d-82d2-513cad131611 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:23.168632 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-7dcea6cd-d683-4c7d-82d2-513cad131611 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:23.179140 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7dcea6cd-d683-4c7d-82d2-513cad131611 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:23.179595 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7dcea6cd-d683-4c7d-82d2-513cad131611 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:23.180354 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7dcea6cd-d683-4c7d-82d2-513cad131611 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:23.180788 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7dcea6cd-d683-4c7d-82d2-513cad131611 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:23.330491 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-416581ee-a198-4214-955f-1460a50eab04 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:23.330491 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-416581ee-a198-4214-955f-1460a50eab04 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:23.333451 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-416581ee-a198-4214-955f-1460a50eab04 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:23.333898 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-416581ee-a198-4214-955f-1460a50eab04 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:23.335549 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-416581ee-a198-4214-955f-1460a50eab04 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:23.335983 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-416581ee-a198-4214-955f-1460a50eab04 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:23.346379 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-7dcea6cd-d683-4c7d-82d2-513cad131611 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:23.361094 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-7dcea6cd-d683-4c7d-82d2-513cad131611 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1521 microversion: 2.1 time: 0.196910 May 26 15:10:23.363119 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 159/282] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:23 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:23.379424 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-416581ee-a198-4214-955f-1460a50eab04 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:23.379870 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-416581ee-a198-4214-955f-1460a50eab04 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:23.380336 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.objects.instance [None req-416581ee-a198-4214-955f-1460a50eab04 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lazy-loading 'fault' on Instance uuid 8045b554-0891-4c2c-a842-76b806f8e817 {{(pid=117798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:10:23.430342 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-416581ee-a198-4214-955f-1460a50eab04 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7a1284bc044e51923c72a9f8f41d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39490fef872043d1bfef791dd0bbb5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:23.439045 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-416581ee-a198-4214-955f-1460a50eab04 tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 200 len: 1350 microversion: 2.1 time: 0.117421 May 26 15:10:23.439654 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 124/283] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:23 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 1350 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:10:24.378471 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-35d2149b-2f2e-4ff0-99e5-46ec9460b9bf tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:24.379106 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-35d2149b-2f2e-4ff0-99e5-46ec9460b9bf tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:24.384957 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-35d2149b-2f2e-4ff0-99e5-46ec9460b9bf tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:24.385405 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-35d2149b-2f2e-4ff0-99e5-46ec9460b9bf tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:24.386178 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-35d2149b-2f2e-4ff0-99e5-46ec9460b9bf tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:24.386718 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-35d2149b-2f2e-4ff0-99e5-46ec9460b9bf tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:24.457243 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-5d8a75ee-2fd6-45d1-a0d0-54ff9737b77d tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:24.457850 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-5d8a75ee-2fd6-45d1-a0d0-54ff9737b77d tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:24.465002 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5d8a75ee-2fd6-45d1-a0d0-54ff9737b77d tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:24.465452 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5d8a75ee-2fd6-45d1-a0d0-54ff9737b77d tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:24.466257 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5d8a75ee-2fd6-45d1-a0d0-54ff9737b77d tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:24.466687 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5d8a75ee-2fd6-45d1-a0d0-54ff9737b77d tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:24.483843 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-5d8a75ee-2fd6-45d1-a0d0-54ff9737b77d tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] HTTP exception thrown: Instance 8045b554-0891-4c2c-a842-76b806f8e817 could not be found. May 26 15:10:24.493509 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-5d8a75ee-2fd6-45d1-a0d0-54ff9737b77d tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Request method failure captured: May 26 15:10:24.493509 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: request: GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 HTTP/1.1 May 26 15:10:24.493509 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept: application/json May 26 15:10:24.493509 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity May 26 15:10:24.493509 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Connection: close May 26 15:10:24.493509 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Length: 0 May 26 15:10:24.493509 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Type: application/json May 26 15:10:24.493509 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Host: 10.222.0.45 May 26 15:10:24.493509 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None May 26 15:10:24.493509 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 May 26 15:10:24.493509 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABij5f5kbtCsMvSNXDlcZZDDXgyBmgX-AToN6uKsUBRUXGSR2HmdDYBZGe-QS8PNI6k6JnEplx6gzrk4rJFXWUAT5fk_QIuzq0PCGATav65u49Ecat-ogh7DQyn6Ch74ilR9Y5eUQ9Vfn0D6BbEdrwSzj8hwIR0P-otDcrIfj6d_WoNb_Q May 26 15:10:24.493509 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Id: None May 26 15:10:24.493509 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Name: None May 26 15:10:24.493509 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed May 26 15:10:24.493509 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True May 26 15:10:24.493509 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default May 26 15:10:24.493509 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default May 26 15:10:24.493509 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Id: 39490fef872043d1bfef791dd0bbb5a5 May 26 15:10:24.493509 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-DeleteServersTestJSON-734442587 May 26 15:10:24.493509 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Role: reader,member May 26 15:10:24.493509 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Roles: reader,member May 26 15:10:24.494749 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/39490fef872043d1bfef791dd0bbb5a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/39490fef872043d1bfef791dd0bbb5a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/39490fef872043d1bfef791dd0bbb5a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_39490fef872043d1bfef791dd0bbb5a5"}]}] May 26 15:10:24.494749 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-DeleteServersTestJSON-734442587 May 26 15:10:24.494749 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Id: 39490fef872043d1bfef791dd0bbb5a5 May 26 15:10:24.494749 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-DeleteServersTestJSON-734442587 May 26 15:10:24.494749 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User: tempest-DeleteServersTestJSON-734442587-project May 26 15:10:24.494749 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default May 26 15:10:24.494749 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default May 26 15:10:24.494749 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Id: 3b7a1284bc044e51923c72a9f8f41d95 May 26 15:10:24.494749 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-DeleteServersTestJSON-734442587-project May 26 15:10:24.494749 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: method: > May 26 15:10:24.494749 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: exception: Instance 8045b554-0891-4c2c-a842-76b806f8e817 could not be found. May 26 15:10:24.494749 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: action_args: {'id': '8045b554-0891-4c2c-a842-76b806f8e817'} May 26 15:10:24.495527 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:10:24.495527 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:10:24.495527 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:10:24.495527 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:10:24.495527 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:10:24.495527 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:10:24.495527 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:10:24.495527 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:10:24.495527 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:10:24.495527 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:10:24.495527 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8045b554-0891-4c2c-a842-76b806f8e817 could not be found. May 26 15:10:24.495527 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:10:24.495527 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:10:24.495527 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:10:24.495527 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:10:24.495527 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:10:24.495527 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:10:24.495527 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:10:24.495527 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:10:24.495527 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:10:24.500523 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:10:24.500523 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:10:24.500523 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:10:24.500523 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:10:24.500523 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:10:24.500523 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:10:24.500523 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:10:24.500523 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8045b554-0891-4c2c-a842-76b806f8e817 could not be found. May 26 15:10:24.500523 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:10:24.500523 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:10:24.500523 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:10:24.500523 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:10:24.500523 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:10:24.500523 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:10:24.500523 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:10:24.500523 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:10:24.500523 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8045b554-0891-4c2c-a842-76b806f8e817 could not be found. May 26 15:10:24.500523 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:10:24.501704 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-5d8a75ee-2fd6-45d1-a0d0-54ff9737b77d tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Returning 404 to user: Instance 8045b554-0891-4c2c-a842-76b806f8e817 could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:10:24.501704 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-5d8a75ee-2fd6-45d1-a0d0-54ff9737b77d tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 404 len: 111 microversion: 2.1 time: 0.042690 May 26 15:10:24.501704 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 125/284] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:24 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:10:24.538120 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-35d2149b-2f2e-4ff0-99e5-46ec9460b9bf tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:24.546409 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-35d2149b-2f2e-4ff0-99e5-46ec9460b9bf tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1521 microversion: 2.1 time: 0.171925 May 26 15:10:24.546816 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 160/285] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:24 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:24.622623 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-51fbc15e-44da-456d-9593-5d0b6430b47d tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:24.623689 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-51fbc15e-44da-456d-9593-5d0b6430b47d tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:24.633585 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-51fbc15e-44da-456d-9593-5d0b6430b47d tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:24.634038 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-51fbc15e-44da-456d-9593-5d0b6430b47d tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:24.634809 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-51fbc15e-44da-456d-9593-5d0b6430b47d tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:24.635323 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-51fbc15e-44da-456d-9593-5d0b6430b47d tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:24.648036 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-51fbc15e-44da-456d-9593-5d0b6430b47d tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] HTTP exception thrown: Instance 8045b554-0891-4c2c-a842-76b806f8e817 could not be found. May 26 15:10:24.650442 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-51fbc15e-44da-456d-9593-5d0b6430b47d tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Request method failure captured: May 26 15:10:24.650442 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: request: GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817/os-volume_attachments HTTP/1.1 May 26 15:10:24.650442 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept: application/json May 26 15:10:24.650442 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity May 26 15:10:24.650442 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Connection: close May 26 15:10:24.650442 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Length: 0 May 26 15:10:24.650442 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Type: application/json May 26 15:10:24.650442 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Host: 10.222.0.45 May 26 15:10:24.650442 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None May 26 15:10:24.650442 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 May 26 15:10:24.650442 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABij5f5kbtCsMvSNXDlcZZDDXgyBmgX-AToN6uKsUBRUXGSR2HmdDYBZGe-QS8PNI6k6JnEplx6gzrk4rJFXWUAT5fk_QIuzq0PCGATav65u49Ecat-ogh7DQyn6Ch74ilR9Y5eUQ9Vfn0D6BbEdrwSzj8hwIR0P-otDcrIfj6d_WoNb_Q May 26 15:10:24.650442 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Id: None May 26 15:10:24.650442 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Name: None May 26 15:10:24.650442 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed May 26 15:10:24.650442 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True May 26 15:10:24.650442 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default May 26 15:10:24.650442 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default May 26 15:10:24.650442 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Id: 39490fef872043d1bfef791dd0bbb5a5 May 26 15:10:24.650442 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-DeleteServersTestJSON-734442587 May 26 15:10:24.650442 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Role: reader,member May 26 15:10:24.650442 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Roles: reader,member May 26 15:10:24.651832 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/39490fef872043d1bfef791dd0bbb5a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/39490fef872043d1bfef791dd0bbb5a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/39490fef872043d1bfef791dd0bbb5a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_39490fef872043d1bfef791dd0bbb5a5"}]}] May 26 15:10:24.651832 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-DeleteServersTestJSON-734442587 May 26 15:10:24.651832 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Id: 39490fef872043d1bfef791dd0bbb5a5 May 26 15:10:24.651832 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-DeleteServersTestJSON-734442587 May 26 15:10:24.651832 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User: tempest-DeleteServersTestJSON-734442587-project May 26 15:10:24.651832 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default May 26 15:10:24.651832 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default May 26 15:10:24.651832 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Id: 3b7a1284bc044e51923c72a9f8f41d95 May 26 15:10:24.651832 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-DeleteServersTestJSON-734442587-project May 26 15:10:24.651832 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: method: > May 26 15:10:24.651832 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: exception: Instance 8045b554-0891-4c2c-a842-76b806f8e817 could not be found. May 26 15:10:24.651832 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: action_args: {'server_id': '8045b554-0891-4c2c-a842-76b806f8e817'} May 26 15:10:24.652576 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:10:24.652576 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:10:24.652576 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:10:24.652576 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:10:24.652576 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:10:24.652576 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:10:24.652576 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:10:24.652576 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:10:24.652576 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:10:24.652576 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:10:24.652576 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8045b554-0891-4c2c-a842-76b806f8e817 could not be found. May 26 15:10:24.652576 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:10:24.652576 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:10:24.652576 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:10:24.652576 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:10:24.652576 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:10:24.652576 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:10:24.652576 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:10:24.652576 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:10:24.652576 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:10:24.653899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:10:24.653899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 26 15:10:24.653899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 15:10:24.653899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 26 15:10:24.653899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 15:10:24.653899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 26 15:10:24.653899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 26 15:10:24.653899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:10:24.653899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:10:24.653899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8045b554-0891-4c2c-a842-76b806f8e817 could not be found. May 26 15:10:24.653899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:10:24.653899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:10:24.653899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:10:24.653899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:10:24.653899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:10:24.653899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:10:24.653899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:10:24.653899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:10:24.653899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8045b554-0891-4c2c-a842-76b806f8e817 could not be found. May 26 15:10:24.653899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:10:24.655929 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-51fbc15e-44da-456d-9593-5d0b6430b47d tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Returning 404 to user: Instance 8045b554-0891-4c2c-a842-76b806f8e817 could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:10:24.655929 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-51fbc15e-44da-456d-9593-5d0b6430b47d tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036199 May 26 15:10:24.655929 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 126/286] 10.222.0.45 () {58 vars in 1301 bytes} [Thu May 26 15:10:24 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:10:25.563829 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-dfb857f6-46be-4c59-9e73-434fd36d07b3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:25.564429 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-dfb857f6-46be-4c59-9e73-434fd36d07b3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:25.571387 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dfb857f6-46be-4c59-9e73-434fd36d07b3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:25.571837 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dfb857f6-46be-4c59-9e73-434fd36d07b3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:25.572669 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dfb857f6-46be-4c59-9e73-434fd36d07b3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:25.573102 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dfb857f6-46be-4c59-9e73-434fd36d07b3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:25.719653 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-dfb857f6-46be-4c59-9e73-434fd36d07b3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:25.727251 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-dfb857f6-46be-4c59-9e73-434fd36d07b3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1521 microversion: 2.1 time: 0.168271 May 26 15:10:25.728188 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 161/287] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:25 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:25.885539 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-21e189a8-153a-47a0-9fc6-91f8def2cc7f tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:25.886032 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-21e189a8-153a-47a0-9fc6-91f8def2cc7f tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:25.893544 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-21e189a8-153a-47a0-9fc6-91f8def2cc7f tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:25.893983 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-21e189a8-153a-47a0-9fc6-91f8def2cc7f tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:25.894740 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-21e189a8-153a-47a0-9fc6-91f8def2cc7f tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:25.895204 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-21e189a8-153a-47a0-9fc6-91f8def2cc7f tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:25.912576 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-21e189a8-153a-47a0-9fc6-91f8def2cc7f tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] HTTP exception thrown: Instance 8045b554-0891-4c2c-a842-76b806f8e817 could not be found. May 26 15:10:25.914473 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-21e189a8-153a-47a0-9fc6-91f8def2cc7f tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Request method failure captured: May 26 15:10:25.914473 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: request: DELETE /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 HTTP/1.1 May 26 15:10:25.914473 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept: application/json May 26 15:10:25.914473 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity May 26 15:10:25.914473 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Connection: close May 26 15:10:25.914473 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Length: 0 May 26 15:10:25.914473 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Type: application/json May 26 15:10:25.914473 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Host: 10.222.0.45 May 26 15:10:25.914473 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None May 26 15:10:25.914473 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 May 26 15:10:25.914473 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABij5f5kbtCsMvSNXDlcZZDDXgyBmgX-AToN6uKsUBRUXGSR2HmdDYBZGe-QS8PNI6k6JnEplx6gzrk4rJFXWUAT5fk_QIuzq0PCGATav65u49Ecat-ogh7DQyn6Ch74ilR9Y5eUQ9Vfn0D6BbEdrwSzj8hwIR0P-otDcrIfj6d_WoNb_Q May 26 15:10:25.914473 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Id: None May 26 15:10:25.914473 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Name: None May 26 15:10:25.914473 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed May 26 15:10:25.914473 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True May 26 15:10:25.914473 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default May 26 15:10:25.914473 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default May 26 15:10:25.914473 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Id: 39490fef872043d1bfef791dd0bbb5a5 May 26 15:10:25.914473 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-DeleteServersTestJSON-734442587 May 26 15:10:25.914473 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Role: reader,member May 26 15:10:25.914473 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Roles: reader,member May 26 15:10:25.916095 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/39490fef872043d1bfef791dd0bbb5a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/39490fef872043d1bfef791dd0bbb5a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/39490fef872043d1bfef791dd0bbb5a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_39490fef872043d1bfef791dd0bbb5a5"}]}] May 26 15:10:25.916095 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-DeleteServersTestJSON-734442587 May 26 15:10:25.916095 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Id: 39490fef872043d1bfef791dd0bbb5a5 May 26 15:10:25.916095 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-DeleteServersTestJSON-734442587 May 26 15:10:25.916095 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User: tempest-DeleteServersTestJSON-734442587-project May 26 15:10:25.916095 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default May 26 15:10:25.916095 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default May 26 15:10:25.916095 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Id: 3b7a1284bc044e51923c72a9f8f41d95 May 26 15:10:25.916095 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-DeleteServersTestJSON-734442587-project May 26 15:10:25.916095 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: method: > May 26 15:10:25.916095 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: exception: Instance 8045b554-0891-4c2c-a842-76b806f8e817 could not be found. May 26 15:10:25.916095 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: action_args: {'id': '8045b554-0891-4c2c-a842-76b806f8e817'} May 26 15:10:25.916869 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:10:25.916869 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:10:25.916869 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:10:25.916869 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:10:25.916869 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:10:25.916869 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:10:25.916869 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:10:25.916869 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:10:25.916869 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:10:25.916869 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:10:25.916869 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8045b554-0891-4c2c-a842-76b806f8e817 could not be found. May 26 15:10:25.916869 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:10:25.916869 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:10:25.916869 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:10:25.916869 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:10:25.916869 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:10:25.916869 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:10:25.916869 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:10:25.916869 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:10:25.916869 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:10:25.918187 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:10:25.918187 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 15:10:25.918187 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 15:10:25.918187 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 15:10:25.918187 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 15:10:25.918187 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:10:25.918187 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:10:25.918187 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:10:25.918187 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:10:25.918187 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8045b554-0891-4c2c-a842-76b806f8e817 could not be found. May 26 15:10:25.918187 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:10:25.918187 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:10:25.918187 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:10:25.918187 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:10:25.918187 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:10:25.918187 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:10:25.918187 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:10:25.918187 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:10:25.918187 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8045b554-0891-4c2c-a842-76b806f8e817 could not be found. May 26 15:10:25.918187 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:10:25.919526 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-21e189a8-153a-47a0-9fc6-91f8def2cc7f tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Returning 404 to user: Instance 8045b554-0891-4c2c-a842-76b806f8e817 could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:10:25.919526 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-21e189a8-153a-47a0-9fc6-91f8def2cc7f tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 404 len: 111 microversion: 2.1 time: 0.034318 May 26 15:10:25.919526 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 127/288] 10.222.0.45 () {58 vars in 1238 bytes} [Thu May 26 15:10:25 2022] DELETE /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:10:25.925738 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-a74a21fb-52ac-4d2e-9218-ad3352e3a3ce tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:25.926566 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-a74a21fb-52ac-4d2e-9218-ad3352e3a3ce tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] [instance: 8045b554-0891-4c2c-a842-76b806f8e817] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:25.932865 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a74a21fb-52ac-4d2e-9218-ad3352e3a3ce tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:25.933347 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a74a21fb-52ac-4d2e-9218-ad3352e3a3ce tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:25.934125 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a74a21fb-52ac-4d2e-9218-ad3352e3a3ce tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:25.934560 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a74a21fb-52ac-4d2e-9218-ad3352e3a3ce tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:25.948741 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.wsgi [None req-a74a21fb-52ac-4d2e-9218-ad3352e3a3ce tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] HTTP exception thrown: Instance 8045b554-0891-4c2c-a842-76b806f8e817 could not be found. May 26 15:10:25.953786 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-a74a21fb-52ac-4d2e-9218-ad3352e3a3ce tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Request method failure captured: May 26 15:10:25.953786 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: request: GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 HTTP/1.1 May 26 15:10:25.953786 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept: application/json May 26 15:10:25.953786 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept-Encoding: identity May 26 15:10:25.953786 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Connection: close May 26 15:10:25.953786 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Length: 0 May 26 15:10:25.953786 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Type: application/json May 26 15:10:25.953786 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Host: 10.222.0.45 May 26 15:10:25.953786 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Openstack-System-Scope: None May 26 15:10:25.953786 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: User-Agent: python-urllib3/1.26.9 May 26 15:10:25.953786 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Auth-Token: gAAAAABij5f5kbtCsMvSNXDlcZZDDXgyBmgX-AToN6uKsUBRUXGSR2HmdDYBZGe-QS8PNI6k6JnEplx6gzrk4rJFXWUAT5fk_QIuzq0PCGATav65u49Ecat-ogh7DQyn6Ch74ilR9Y5eUQ9Vfn0D6BbEdrwSzj8hwIR0P-otDcrIfj6d_WoNb_Q May 26 15:10:25.953786 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Id: None May 26 15:10:25.953786 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Name: None May 26 15:10:25.953786 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Identity-Status: Confirmed May 26 15:10:25.953786 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Is-Admin-Project: True May 26 15:10:25.953786 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Id: default May 26 15:10:25.953786 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Name: Default May 26 15:10:25.953786 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Id: 39490fef872043d1bfef791dd0bbb5a5 May 26 15:10:25.953786 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Name: tempest-DeleteServersTestJSON-734442587 May 26 15:10:25.953786 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Role: reader,member May 26 15:10:25.953786 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Roles: reader,member May 26 15:10:25.955188 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/39490fef872043d1bfef791dd0bbb5a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/39490fef872043d1bfef791dd0bbb5a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/39490fef872043d1bfef791dd0bbb5a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_39490fef872043d1bfef791dd0bbb5a5"}]}] May 26 15:10:25.955188 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant: tempest-DeleteServersTestJSON-734442587 May 26 15:10:25.955188 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Id: 39490fef872043d1bfef791dd0bbb5a5 May 26 15:10:25.955188 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Name: tempest-DeleteServersTestJSON-734442587 May 26 15:10:25.955188 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User: tempest-DeleteServersTestJSON-734442587-project May 26 15:10:25.955188 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Id: default May 26 15:10:25.955188 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Name: Default May 26 15:10:25.955188 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Id: 3b7a1284bc044e51923c72a9f8f41d95 May 26 15:10:25.955188 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Name: tempest-DeleteServersTestJSON-734442587-project May 26 15:10:25.955188 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: method: > May 26 15:10:25.955188 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: exception: Instance 8045b554-0891-4c2c-a842-76b806f8e817 could not be found. May 26 15:10:25.955188 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: action_args: {'id': '8045b554-0891-4c2c-a842-76b806f8e817'} May 26 15:10:25.955939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:10:25.955939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:10:25.955939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:10:25.955939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:10:25.955939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:10:25.955939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:10:25.955939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:10:25.955939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:10:25.955939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:10:25.955939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:10:25.955939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8045b554-0891-4c2c-a842-76b806f8e817 could not be found. May 26 15:10:25.955939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:10:25.955939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:10:25.955939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:10:25.955939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:10:25.955939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:10:25.955939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:10:25.955939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:10:25.955939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:10:25.955939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:10:25.957286 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:10:25.957286 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:10:25.957286 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:10:25.957286 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:10:25.957286 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:10:25.957286 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:10:25.957286 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:10:25.957286 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8045b554-0891-4c2c-a842-76b806f8e817 could not be found. May 26 15:10:25.957286 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:10:25.957286 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:10:25.957286 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:10:25.957286 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:10:25.957286 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:10:25.957286 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:10:25.957286 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:10:25.957286 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:10:25.957286 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8045b554-0891-4c2c-a842-76b806f8e817 could not be found. May 26 15:10:25.957286 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:10:25.958420 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-a74a21fb-52ac-4d2e-9218-ad3352e3a3ce tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] Returning 404 to user: Instance 8045b554-0891-4c2c-a842-76b806f8e817 could not be found. {{(pid=117799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:10:25.958420 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-a74a21fb-52ac-4d2e-9218-ad3352e3a3ce tempest-DeleteServersTestJSON-734442587 tempest-DeleteServersTestJSON-734442587-project] 10.222.0.45 "GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817" status: 404 len: 111 microversion: 2.1 time: 0.033452 May 26 15:10:25.958420 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 162/289] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:25 2022] GET /compute/v2.1/servers/8045b554-0891-4c2c-a842-76b806f8e817 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:10:26.745076 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-66dc2186-66d1-4870-a7dc-97a8e9e5352c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:26.745798 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-66dc2186-66d1-4870-a7dc-97a8e9e5352c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:26.755625 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-66dc2186-66d1-4870-a7dc-97a8e9e5352c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:26.756309 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-66dc2186-66d1-4870-a7dc-97a8e9e5352c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:26.757274 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-66dc2186-66d1-4870-a7dc-97a8e9e5352c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:26.757890 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-66dc2186-66d1-4870-a7dc-97a8e9e5352c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:27.019198 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-66dc2186-66d1-4870-a7dc-97a8e9e5352c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:27.029410 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-66dc2186-66d1-4870-a7dc-97a8e9e5352c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1521 microversion: 2.1 time: 0.288224 May 26 15:10:27.030096 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 128/290] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:26 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:27.954718 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-8b76c879-db03-4ba6-a54f-8d979d4c537d tempest-VolumesGetTestJSON-1880655968 tempest-VolumesGetTestJSON-1880655968-project] Action: 'create', calling method: .version_select at 0x7ffb5d87da60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1991748850", "metadata": {"Type": "work"}}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:10:28.053322 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-87db787e-6e75-4e8c-a7d3-51a01930a6de tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:28.053985 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-87db787e-6e75-4e8c-a7d3-51a01930a6de tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:28.062924 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:28.064867 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-87db787e-6e75-4e8c-a7d3-51a01930a6de tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:28.065324 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-87db787e-6e75-4e8c-a7d3-51a01930a6de tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:28.066113 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-87db787e-6e75-4e8c-a7d3-51a01930a6de tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:28.066803 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-87db787e-6e75-4e8c-a7d3-51a01930a6de tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:28.085863 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:28.238972 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-87db787e-6e75-4e8c-a7d3-51a01930a6de tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:28.247802 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-87db787e-6e75-4e8c-a7d3-51a01930a6de tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1521 microversion: 2.1 time: 0.200661 May 26 15:10:28.248915 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 129/291] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:28 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:28.377778 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-8b76c879-db03-4ba6-a54f-8d979d4c537d tempest-VolumesGetTestJSON-1880655968 tempest-VolumesGetTestJSON-1880655968-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.547132 May 26 15:10:28.379327 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 163/292] 10.222.0.45 () {60 vars in 1155 bytes} [Thu May 26 15:10:27 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 549 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 26 15:10:28.397419 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-32aef6d8-e9e4-4aa7-8597-ffe99cbe1ba2 tempest-VolumesGetTestJSON-1880655968 tempest-VolumesGetTestJSON-1880655968-project] Calling method '.version_select at 0x7ffb5e9bd670>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:28.452261 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-32aef6d8-e9e4-4aa7-8597-ffe99cbe1ba2 tempest-VolumesGetTestJSON-1880655968 tempest-VolumesGetTestJSON-1880655968-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/3e8556f9-348f-4fcf-9c00-952544def5cf" status: 200 len: 353 microversion: 2.1 time: 0.060452 May 26 15:10:28.455189 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 130/293] 10.222.0.45 () {58 vars in 1244 bytes} [Thu May 26 15:10:28 2022] GET /compute/v2.1/os-volumes/3e8556f9-348f-4fcf-9c00-952544def5cf => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:10:29.270557 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-7eb99505-0ce3-42c9-955e-1b0d44f2f32a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:29.271242 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-7eb99505-0ce3-42c9-955e-1b0d44f2f32a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:29.278818 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7eb99505-0ce3-42c9-955e-1b0d44f2f32a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:29.279297 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7eb99505-0ce3-42c9-955e-1b0d44f2f32a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:29.280540 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7eb99505-0ce3-42c9-955e-1b0d44f2f32a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:29.280981 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7eb99505-0ce3-42c9-955e-1b0d44f2f32a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:29.426548 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-7eb99505-0ce3-42c9-955e-1b0d44f2f32a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:29.435173 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-7eb99505-0ce3-42c9-955e-1b0d44f2f32a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1521 microversion: 2.1 time: 0.168534 May 26 15:10:29.435736 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 164/294] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:29 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:29.465733 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e8ea3932-5354-47ba-bab9-96a5803e3401 tempest-VolumesGetTestJSON-1880655968 tempest-VolumesGetTestJSON-1880655968-project] Calling method '.version_select at 0x7ffb5e993dc0>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:29.516888 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e8ea3932-5354-47ba-bab9-96a5803e3401 tempest-VolumesGetTestJSON-1880655968 tempest-VolumesGetTestJSON-1880655968-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/3e8556f9-348f-4fcf-9c00-952544def5cf" status: 200 len: 354 microversion: 2.1 time: 0.056209 May 26 15:10:29.517829 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 131/295] 10.222.0.45 () {58 vars in 1244 bytes} [Thu May 26 15:10:29 2022] GET /compute/v2.1/os-volumes/3e8556f9-348f-4fcf-9c00-952544def5cf => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:10:29.533865 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-e7ea8263-5b30-4b7b-bcdc-b467c6fdf24f tempest-VolumesGetTestJSON-1880655968 tempest-VolumesGetTestJSON-1880655968-project] Calling method '.version_select at 0x7ffb5d87d940>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:29.588918 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-e7ea8263-5b30-4b7b-bcdc-b467c6fdf24f tempest-VolumesGetTestJSON-1880655968 tempest-VolumesGetTestJSON-1880655968-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/3e8556f9-348f-4fcf-9c00-952544def5cf" status: 200 len: 354 microversion: 2.1 time: 0.060798 May 26 15:10:29.589495 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 165/296] 10.222.0.45 () {58 vars in 1244 bytes} [Thu May 26 15:10:29 2022] GET /compute/v2.1/os-volumes/3e8556f9-348f-4fcf-9c00-952544def5cf => generated 354 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:10:29.607228 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-7fd4f0f7-fd7b-4da2-8700-61384c5bb234 tempest-VolumesGetTestJSON-1880655968 tempest-VolumesGetTestJSON-1880655968-project] Calling method '.version_select at 0x7ffb5ea249d0>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:29.677604 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-7fd4f0f7-fd7b-4da2-8700-61384c5bb234 tempest-VolumesGetTestJSON-1880655968 tempest-VolumesGetTestJSON-1880655968-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/3e8556f9-348f-4fcf-9c00-952544def5cf" status: 202 len: 0 microversion: 2.1 time: 0.074273 May 26 15:10:29.678186 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 132/297] 10.222.0.45 () {58 vars in 1247 bytes} [Thu May 26 15:10:29 2022] DELETE /compute/v2.1/os-volumes/3e8556f9-348f-4fcf-9c00-952544def5cf => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:10:29.688648 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-b2519a3f-0525-4e52-a3d8-b81f840be07c tempest-VolumesGetTestJSON-1880655968 tempest-VolumesGetTestJSON-1880655968-project] Calling method '.version_select at 0x7ffb5d80da60>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:29.739798 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-b2519a3f-0525-4e52-a3d8-b81f840be07c tempest-VolumesGetTestJSON-1880655968 tempest-VolumesGetTestJSON-1880655968-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/3e8556f9-348f-4fcf-9c00-952544def5cf" status: 200 len: 353 microversion: 2.1 time: 0.057280 May 26 15:10:29.740760 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 166/298] 10.222.0.45 () {58 vars in 1244 bytes} [Thu May 26 15:10:29 2022] GET /compute/v2.1/os-volumes/3e8556f9-348f-4fcf-9c00-952544def5cf => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:10:30.451477 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-17cc9ce7-266c-4f3e-9734-9f05cc403a0f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:30.452536 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-17cc9ce7-266c-4f3e-9734-9f05cc403a0f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:30.459794 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-17cc9ce7-266c-4f3e-9734-9f05cc403a0f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:30.460262 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-17cc9ce7-266c-4f3e-9734-9f05cc403a0f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:30.461023 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-17cc9ce7-266c-4f3e-9734-9f05cc403a0f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:30.461464 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-17cc9ce7-266c-4f3e-9734-9f05cc403a0f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:30.605660 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-17cc9ce7-266c-4f3e-9734-9f05cc403a0f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:30.617739 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-17cc9ce7-266c-4f3e-9734-9f05cc403a0f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1521 microversion: 2.1 time: 0.170114 May 26 15:10:30.618331 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 133/299] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:30 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:30.751976 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-e81c9412-aff9-49f3-acf8-65fc2dd18e5f tempest-VolumesGetTestJSON-1880655968 tempest-VolumesGetTestJSON-1880655968-project] Calling method '.version_select at 0x7ffb5d80d1f0>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:30.781216 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.wsgi [None req-e81c9412-aff9-49f3-acf8-65fc2dd18e5f tempest-VolumesGetTestJSON-1880655968 tempest-VolumesGetTestJSON-1880655968-project] HTTP exception thrown: Volume 3e8556f9-348f-4fcf-9c00-952544def5cf could not be found. May 26 15:10:30.783283 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-e81c9412-aff9-49f3-acf8-65fc2dd18e5f tempest-VolumesGetTestJSON-1880655968 tempest-VolumesGetTestJSON-1880655968-project] Request method failure captured: May 26 15:10:30.783283 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: request: GET /compute/v2.1/os-volumes/3e8556f9-348f-4fcf-9c00-952544def5cf HTTP/1.1 May 26 15:10:30.783283 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept: application/json May 26 15:10:30.783283 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept-Encoding: identity May 26 15:10:30.783283 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Connection: close May 26 15:10:30.783283 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Length: 0 May 26 15:10:30.783283 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Type: application/json May 26 15:10:30.783283 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Host: 10.222.0.45 May 26 15:10:30.783283 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Openstack-System-Scope: None May 26 15:10:30.783283 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: User-Agent: python-urllib3/1.26.9 May 26 15:10:30.783283 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Auth-Token: gAAAAABij5hjYeMMr7KmaXtLOEdori0_jXXOid4kLIBxCXSv55hvVrdwhjgRgXarsANdP7s2GI6g7-x0mNYveWbuIqMYKCBqP8_4J4tZEWBYByPOWHP3IXkj1z6xVtRQvwwLlPMDMsc_KJmEMbbcxdSpg09uOeYOERbD6YdnxeF7Gf3ECBk_kWM May 26 15:10:30.783283 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Id: None May 26 15:10:30.783283 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Name: None May 26 15:10:30.783283 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Identity-Status: Confirmed May 26 15:10:30.783283 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Is-Admin-Project: True May 26 15:10:30.783283 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Id: default May 26 15:10:30.783283 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Name: Default May 26 15:10:30.783283 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Id: 0481ff1d91a64d39b39d3dad413df8e5 May 26 15:10:30.783283 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Name: tempest-VolumesGetTestJSON-1880655968 May 26 15:10:30.783283 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Role: reader,member May 26 15:10:30.783283 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Roles: reader,member May 26 15:10:30.784619 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0481ff1d91a64d39b39d3dad413df8e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0481ff1d91a64d39b39d3dad413df8e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0481ff1d91a64d39b39d3dad413df8e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0481ff1d91a64d39b39d3dad413df8e5"}]}] May 26 15:10:30.784619 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant: tempest-VolumesGetTestJSON-1880655968 May 26 15:10:30.784619 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Id: 0481ff1d91a64d39b39d3dad413df8e5 May 26 15:10:30.784619 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Name: tempest-VolumesGetTestJSON-1880655968 May 26 15:10:30.784619 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User: tempest-VolumesGetTestJSON-1880655968-project May 26 15:10:30.784619 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Id: default May 26 15:10:30.784619 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Name: Default May 26 15:10:30.784619 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Id: b6bae679777d474d838f8f5998a16f56 May 26 15:10:30.784619 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Name: tempest-VolumesGetTestJSON-1880655968-project May 26 15:10:30.784619 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: method: May 26 15:10:30.784619 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: exception: Volume 3e8556f9-348f-4fcf-9c00-952544def5cf could not be found. May 26 15:10:30.784619 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: action_args: {'id': '3e8556f9-348f-4fcf-9c00-952544def5cf'} May 26 15:10:30.784619 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:10:30.785437 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:10:30.785437 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 15:10:30.785437 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 15:10:30.785437 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 15:10:30.785437 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 15:10:30.785437 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 15:10:30.785437 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 15:10:30.785437 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 15:10:30.785437 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 15:10:30.785437 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 15:10:30.785437 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 15:10:30.785437 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 15:10:30.785437 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 15:10:30.785437 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 15:10:30.785437 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 15:10:30.785437 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3e8556f9-348f-4fcf-9c00-952544def5cf could not be found. (HTTP 404) (Request-ID: req-ac144b70-5dbe-4b16-a49a-5eb1c380ec85) May 26 15:10:30.785437 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:10:30.785437 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:10:30.785437 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:10:30.786486 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:10:30.786486 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 15:10:30.786486 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 15:10:30.786486 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 15:10:30.786486 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 15:10:30.786486 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 15:10:30.786486 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 15:10:30.786486 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 15:10:30.786486 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 15:10:30.786486 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 15:10:30.786486 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 15:10:30.786486 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 15:10:30.786486 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 15:10:30.786486 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 15:10:30.786486 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 15:10:30.786486 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 15:10:30.786486 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 15:10:30.786486 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 15:10:30.786486 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 15:10:30.787506 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 15:10:30.787506 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 15:10:30.787506 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 15:10:30.787506 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 15:10:30.787506 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3e8556f9-348f-4fcf-9c00-952544def5cf could not be found. May 26 15:10:30.787506 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:10:30.787506 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:10:30.787506 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:10:30.787506 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:10:30.787506 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:10:30.787506 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:10:30.787506 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:10:30.787506 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:10:30.787506 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 15:10:30.787506 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 15:10:30.787506 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:10:30.787506 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:10:30.787506 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 15:10:30.787506 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:10:30.788526 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3e8556f9-348f-4fcf-9c00-952544def5cf could not be found. May 26 15:10:30.788526 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:10:30.788526 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:10:30.788526 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:10:30.788526 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:10:30.788526 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:10:30.788526 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:10:30.788526 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:10:30.788526 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:10:30.788526 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3e8556f9-348f-4fcf-9c00-952544def5cf could not be found. May 26 15:10:30.788526 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:10:30.788526 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-e81c9412-aff9-49f3-acf8-65fc2dd18e5f tempest-VolumesGetTestJSON-1880655968 tempest-VolumesGetTestJSON-1880655968-project] Returning 404 to user: Volume 3e8556f9-348f-4fcf-9c00-952544def5cf could not be found. {{(pid=117799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:10:30.788526 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-e81c9412-aff9-49f3-acf8-65fc2dd18e5f tempest-VolumesGetTestJSON-1880655968 tempest-VolumesGetTestJSON-1880655968-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/3e8556f9-348f-4fcf-9c00-952544def5cf" status: 404 len: 109 microversion: 2.1 time: 0.036560 May 26 15:10:30.788526 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 167/300] 10.222.0.45 () {58 vars in 1244 bytes} [Thu May 26 15:10:30 2022] GET /compute/v2.1/os-volumes/3e8556f9-348f-4fcf-9c00-952544def5cf => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:10:31.636829 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-49a988f8-763b-4a61-95a5-c485c744016c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:31.637788 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-49a988f8-763b-4a61-95a5-c485c744016c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:31.649431 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-49a988f8-763b-4a61-95a5-c485c744016c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:31.650111 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-49a988f8-763b-4a61-95a5-c485c744016c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:31.651588 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-49a988f8-763b-4a61-95a5-c485c744016c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:31.652093 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-49a988f8-763b-4a61-95a5-c485c744016c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:31.817644 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-49a988f8-763b-4a61-95a5-c485c744016c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:31.825585 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-49a988f8-763b-4a61-95a5-c485c744016c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1521 microversion: 2.1 time: 0.193732 May 26 15:10:31.831297 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 134/301] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:31 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:32.844068 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-fa81f246-bff0-432b-8974-3601539d618b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:32.845554 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-fa81f246-bff0-432b-8974-3601539d618b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:32.860882 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fa81f246-bff0-432b-8974-3601539d618b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:32.861434 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fa81f246-bff0-432b-8974-3601539d618b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:32.862306 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fa81f246-bff0-432b-8974-3601539d618b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:32.862822 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fa81f246-bff0-432b-8974-3601539d618b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:33.018107 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-fa81f246-bff0-432b-8974-3601539d618b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:33.039898 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-fa81f246-bff0-432b-8974-3601539d618b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1521 microversion: 2.1 time: 0.187246 May 26 15:10:33.041254 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 168/302] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:32 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:34.058004 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-4678c97b-8e82-4a3f-b4c1-0d0348221812 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:34.058605 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-4678c97b-8e82-4a3f-b4c1-0d0348221812 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:34.068914 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4678c97b-8e82-4a3f-b4c1-0d0348221812 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:34.068914 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4678c97b-8e82-4a3f-b4c1-0d0348221812 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:34.068914 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4678c97b-8e82-4a3f-b4c1-0d0348221812 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:34.068914 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4678c97b-8e82-4a3f-b4c1-0d0348221812 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:34.220337 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-4678c97b-8e82-4a3f-b4c1-0d0348221812 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:34.228067 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-4678c97b-8e82-4a3f-b4c1-0d0348221812 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1521 microversion: 2.1 time: 0.173831 May 26 15:10:34.231223 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 135/303] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:34 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:35.253926 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-a2f084cc-e235-4129-9841-41e9cebe285d tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:35.255262 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-a2f084cc-e235-4129-9841-41e9cebe285d tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:35.261964 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a2f084cc-e235-4129-9841-41e9cebe285d tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:35.262410 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a2f084cc-e235-4129-9841-41e9cebe285d tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:35.263396 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a2f084cc-e235-4129-9841-41e9cebe285d tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:35.264690 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a2f084cc-e235-4129-9841-41e9cebe285d tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:35.435159 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-a2f084cc-e235-4129-9841-41e9cebe285d tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:35.443509 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-a2f084cc-e235-4129-9841-41e9cebe285d tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1501 microversion: 2.1 time: 0.201458 May 26 15:10:35.444082 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 169/304] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:35 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1501 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:35.459637 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-6fe56e66-833d-4043-bd55-3fce5be0166a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:35.460238 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-6fe56e66-833d-4043-bd55-3fce5be0166a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: ab471a8e-c724-4c71-b9ce-b253771d23a1] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:35.466671 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6fe56e66-833d-4043-bd55-3fce5be0166a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:35.467265 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6fe56e66-833d-4043-bd55-3fce5be0166a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:35.468225 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6fe56e66-833d-4043-bd55-3fce5be0166a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:35.468696 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6fe56e66-833d-4043-bd55-3fce5be0166a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:35.599630 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6fe56e66-833d-4043-bd55-3fce5be0166a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:35.607355 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-6fe56e66-833d-4043-bd55-3fce5be0166a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1" status: 200 len: 1516 microversion: 2.1 time: 0.151732 May 26 15:10:35.608615 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 136/305] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:35 2022] GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:39.219848 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-43d977ab-e542-4f06-a7db-be7b88659f85 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:10:39.221609 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-43d977ab-e542-4f06-a7db-be7b88659f85 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: ab471a8e-c724-4c71-b9ce-b253771d23a1] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:39.236354 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-43d977ab-e542-4f06-a7db-be7b88659f85 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:39.236952 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-43d977ab-e542-4f06-a7db-be7b88659f85 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:39.238172 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-43d977ab-e542-4f06-a7db-be7b88659f85 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:39.238636 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-43d977ab-e542-4f06-a7db-be7b88659f85 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:39.266918 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.objects.instance [None req-43d977ab-e542-4f06-a7db-be7b88659f85 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lazy-loading 'flavor' on Instance uuid ab471a8e-c724-4c71-b9ce-b253771d23a1 {{(pid=117799) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:10:39.363746 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-43d977ab-e542-4f06-a7db-be7b88659f85 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "POST /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1/action" status: 200 len: 32 microversion: 2.1 time: 0.152859 May 26 15:10:39.364264 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 170/306] 10.222.0.45 () {60 vars in 1277 bytes} [Thu May 26 15:10:39 2022] POST /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1/action => generated 32 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 15:10:39.375976 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b05c1348-7305-491f-a357-72aa27f60d33 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:39.376605 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b05c1348-7305-491f-a357-72aa27f60d33 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: ab471a8e-c724-4c71-b9ce-b253771d23a1] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:39.384624 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b05c1348-7305-491f-a357-72aa27f60d33 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:39.385175 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b05c1348-7305-491f-a357-72aa27f60d33 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:39.385990 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b05c1348-7305-491f-a357-72aa27f60d33 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:39.386419 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b05c1348-7305-491f-a357-72aa27f60d33 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:39.557126 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b05c1348-7305-491f-a357-72aa27f60d33 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:39.566207 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b05c1348-7305-491f-a357-72aa27f60d33 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1" status: 200 len: 1522 microversion: 2.1 time: 0.193701 May 26 15:10:39.566399 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 137/307] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:39 2022] GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:10:40.591204 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-7739df16-09a4-4522-a926-28fdf6ed7fba tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:40.592016 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-7739df16-09a4-4522-a926-28fdf6ed7fba tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: ab471a8e-c724-4c71-b9ce-b253771d23a1] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:40.599360 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7739df16-09a4-4522-a926-28fdf6ed7fba tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:40.599813 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7739df16-09a4-4522-a926-28fdf6ed7fba tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:40.600591 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7739df16-09a4-4522-a926-28fdf6ed7fba tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:40.601691 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7739df16-09a4-4522-a926-28fdf6ed7fba tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:40.765679 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-7739df16-09a4-4522-a926-28fdf6ed7fba tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:40.773870 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-7739df16-09a4-4522-a926-28fdf6ed7fba tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1" status: 200 len: 1522 microversion: 2.1 time: 0.189219 May 26 15:10:40.774552 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 171/308] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:40 2022] GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:41.798109 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f6178d6d-8eca-4903-9b94-ba37f0358126 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:41.799437 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f6178d6d-8eca-4903-9b94-ba37f0358126 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: ab471a8e-c724-4c71-b9ce-b253771d23a1] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:41.810972 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f6178d6d-8eca-4903-9b94-ba37f0358126 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:41.812338 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f6178d6d-8eca-4903-9b94-ba37f0358126 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:41.813792 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f6178d6d-8eca-4903-9b94-ba37f0358126 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:41.814620 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f6178d6d-8eca-4903-9b94-ba37f0358126 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:41.979514 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f6178d6d-8eca-4903-9b94-ba37f0358126 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:41.987659 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f6178d6d-8eca-4903-9b94-ba37f0358126 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1" status: 200 len: 1522 microversion: 2.1 time: 0.199084 May 26 15:10:41.988167 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 138/309] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:41 2022] GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:43.004699 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-6abfa28e-2db1-4ee1-8327-f2b04c316bf0 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:43.005309 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-6abfa28e-2db1-4ee1-8327-f2b04c316bf0 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: ab471a8e-c724-4c71-b9ce-b253771d23a1] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:43.011934 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6abfa28e-2db1-4ee1-8327-f2b04c316bf0 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:43.012458 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6abfa28e-2db1-4ee1-8327-f2b04c316bf0 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:43.013625 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6abfa28e-2db1-4ee1-8327-f2b04c316bf0 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:43.014788 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6abfa28e-2db1-4ee1-8327-f2b04c316bf0 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:43.144162 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-6abfa28e-2db1-4ee1-8327-f2b04c316bf0 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:43.151902 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-6abfa28e-2db1-4ee1-8327-f2b04c316bf0 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1" status: 200 len: 1522 microversion: 2.1 time: 0.151246 May 26 15:10:43.152471 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 172/310] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:42 2022] GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:44.168790 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b80a2c69-b7ba-40ee-a227-ac73dde4f54c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:44.169395 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b80a2c69-b7ba-40ee-a227-ac73dde4f54c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: ab471a8e-c724-4c71-b9ce-b253771d23a1] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:44.176769 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b80a2c69-b7ba-40ee-a227-ac73dde4f54c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:44.177215 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b80a2c69-b7ba-40ee-a227-ac73dde4f54c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:44.178031 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b80a2c69-b7ba-40ee-a227-ac73dde4f54c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:44.178464 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b80a2c69-b7ba-40ee-a227-ac73dde4f54c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:44.315798 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b80a2c69-b7ba-40ee-a227-ac73dde4f54c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:44.323564 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b80a2c69-b7ba-40ee-a227-ac73dde4f54c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1" status: 200 len: 1522 microversion: 2.1 time: 0.158599 May 26 15:10:44.324129 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 139/311] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:44 2022] GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:45.341469 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-2bbf5ef8-a692-4da3-a9a4-a9d1ca441419 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:45.342265 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-2bbf5ef8-a692-4da3-a9a4-a9d1ca441419 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: ab471a8e-c724-4c71-b9ce-b253771d23a1] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:45.348897 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2bbf5ef8-a692-4da3-a9a4-a9d1ca441419 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:45.349339 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2bbf5ef8-a692-4da3-a9a4-a9d1ca441419 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:45.350108 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2bbf5ef8-a692-4da3-a9a4-a9d1ca441419 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:45.350537 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2bbf5ef8-a692-4da3-a9a4-a9d1ca441419 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:45.497040 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-2bbf5ef8-a692-4da3-a9a4-a9d1ca441419 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:45.504757 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-2bbf5ef8-a692-4da3-a9a4-a9d1ca441419 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1" status: 200 len: 1522 microversion: 2.1 time: 0.167006 May 26 15:10:45.505340 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 173/312] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:45 2022] GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:46.534264 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-5d583a72-30d1-4c15-967c-e6b1421331de tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:46.534880 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-5d583a72-30d1-4c15-967c-e6b1421331de tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: ab471a8e-c724-4c71-b9ce-b253771d23a1] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:46.541666 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5d583a72-30d1-4c15-967c-e6b1421331de tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:46.542112 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5d583a72-30d1-4c15-967c-e6b1421331de tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:46.542882 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5d583a72-30d1-4c15-967c-e6b1421331de tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:46.543337 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5d583a72-30d1-4c15-967c-e6b1421331de tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:46.704388 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-5d583a72-30d1-4c15-967c-e6b1421331de tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:46.720796 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-5d583a72-30d1-4c15-967c-e6b1421331de tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1" status: 200 len: 1522 microversion: 2.1 time: 0.202332 May 26 15:10:46.722082 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 140/313] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:46 2022] GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:47.740858 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-1250dcfe-f782-4f58-990c-19a211b62058 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:47.741576 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-1250dcfe-f782-4f58-990c-19a211b62058 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: ab471a8e-c724-4c71-b9ce-b253771d23a1] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:47.748318 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1250dcfe-f782-4f58-990c-19a211b62058 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:47.748689 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1250dcfe-f782-4f58-990c-19a211b62058 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:47.749459 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1250dcfe-f782-4f58-990c-19a211b62058 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:47.749891 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1250dcfe-f782-4f58-990c-19a211b62058 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:47.893801 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-1250dcfe-f782-4f58-990c-19a211b62058 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:47.902753 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-1250dcfe-f782-4f58-990c-19a211b62058 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1" status: 200 len: 1522 microversion: 2.1 time: 0.167121 May 26 15:10:47.903349 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 174/314] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:47 2022] GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:48.921480 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1315abd6-272e-4c84-96fa-b32e19917d27 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:48.922078 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1315abd6-272e-4c84-96fa-b32e19917d27 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: ab471a8e-c724-4c71-b9ce-b253771d23a1] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:48.928898 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1315abd6-272e-4c84-96fa-b32e19917d27 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:48.929347 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1315abd6-272e-4c84-96fa-b32e19917d27 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:48.930278 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1315abd6-272e-4c84-96fa-b32e19917d27 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:48.930722 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1315abd6-272e-4c84-96fa-b32e19917d27 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:49.071448 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1315abd6-272e-4c84-96fa-b32e19917d27 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:49.081098 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1315abd6-272e-4c84-96fa-b32e19917d27 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1" status: 200 len: 1522 microversion: 2.1 time: 0.163410 May 26 15:10:49.081870 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 141/315] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:48 2022] GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:50.099134 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-81fb1312-b506-4ab3-a308-0c8fbed70e2e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:50.099688 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-81fb1312-b506-4ab3-a308-0c8fbed70e2e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: ab471a8e-c724-4c71-b9ce-b253771d23a1] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:50.105845 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-81fb1312-b506-4ab3-a308-0c8fbed70e2e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:50.106284 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-81fb1312-b506-4ab3-a308-0c8fbed70e2e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:50.107039 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-81fb1312-b506-4ab3-a308-0c8fbed70e2e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:50.108381 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-81fb1312-b506-4ab3-a308-0c8fbed70e2e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:50.265633 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-81fb1312-b506-4ab3-a308-0c8fbed70e2e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:50.273361 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-81fb1312-b506-4ab3-a308-0c8fbed70e2e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1" status: 200 len: 1522 microversion: 2.1 time: 0.177917 May 26 15:10:50.274023 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 175/316] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:50 2022] GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:51.289700 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-0d37c5fa-e6b2-4f0e-8618-0aa345a48b5e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:51.290300 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-0d37c5fa-e6b2-4f0e-8618-0aa345a48b5e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: ab471a8e-c724-4c71-b9ce-b253771d23a1] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:51.297494 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0d37c5fa-e6b2-4f0e-8618-0aa345a48b5e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:51.297939 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0d37c5fa-e6b2-4f0e-8618-0aa345a48b5e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:51.298703 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0d37c5fa-e6b2-4f0e-8618-0aa345a48b5e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:51.299331 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0d37c5fa-e6b2-4f0e-8618-0aa345a48b5e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:51.448220 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-0d37c5fa-e6b2-4f0e-8618-0aa345a48b5e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:51.456817 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-0d37c5fa-e6b2-4f0e-8618-0aa345a48b5e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1" status: 200 len: 1522 microversion: 2.1 time: 0.170930 May 26 15:10:51.457398 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 142/317] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:51 2022] GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:52.473707 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-59131161-0b1f-4c13-bb8f-6795c4a4bfbe tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:52.474504 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-59131161-0b1f-4c13-bb8f-6795c4a4bfbe tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: ab471a8e-c724-4c71-b9ce-b253771d23a1] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:52.476429 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_api:SELECT=28 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:52.481817 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-59131161-0b1f-4c13-bb8f-6795c4a4bfbe tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:52.482329 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-59131161-0b1f-4c13-bb8f-6795c4a4bfbe tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:52.483764 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-59131161-0b1f-4c13-bb8f-6795c4a4bfbe tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:52.484198 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-59131161-0b1f-4c13-bb8f-6795c4a4bfbe tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:52.487175 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:52.628414 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-59131161-0b1f-4c13-bb8f-6795c4a4bfbe tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:52.636325 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-59131161-0b1f-4c13-bb8f-6795c4a4bfbe tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1" status: 200 len: 1522 microversion: 2.1 time: 0.166320 May 26 15:10:52.636969 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 176/318] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:52 2022] GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:53.655074 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1b77b708-379e-43d4-94aa-e51579c1f0db tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:53.655812 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1b77b708-379e-43d4-94aa-e51579c1f0db tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: ab471a8e-c724-4c71-b9ce-b253771d23a1] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:53.663189 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1b77b708-379e-43d4-94aa-e51579c1f0db tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:53.663763 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1b77b708-379e-43d4-94aa-e51579c1f0db tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:53.664644 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1b77b708-379e-43d4-94aa-e51579c1f0db tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:53.665162 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1b77b708-379e-43d4-94aa-e51579c1f0db tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:53.815635 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1b77b708-379e-43d4-94aa-e51579c1f0db tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:53.817069 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1b77b708-379e-43d4-94aa-e51579c1f0db tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1" status: 200 len: 1522 microversion: 2.1 time: 0.166645 May 26 15:10:53.818675 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 143/319] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:53 2022] GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:54.835103 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-cf7c0d7b-55bf-47a5-b471-44e33650553e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:54.835724 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-cf7c0d7b-55bf-47a5-b471-44e33650553e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: ab471a8e-c724-4c71-b9ce-b253771d23a1] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:54.842477 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-cf7c0d7b-55bf-47a5-b471-44e33650553e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:54.842928 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-cf7c0d7b-55bf-47a5-b471-44e33650553e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:54.843728 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-cf7c0d7b-55bf-47a5-b471-44e33650553e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:54.844164 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-cf7c0d7b-55bf-47a5-b471-44e33650553e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:54.977071 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-cf7c0d7b-55bf-47a5-b471-44e33650553e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:54.985280 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-cf7c0d7b-55bf-47a5-b471-44e33650553e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1" status: 200 len: 1522 microversion: 2.1 time: 0.154051 May 26 15:10:54.985887 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 177/320] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:54 2022] GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:56.002782 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-038efe39-f17e-4162-9a90-33d59b8238f3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:56.003339 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-038efe39-f17e-4162-9a90-33d59b8238f3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: ab471a8e-c724-4c71-b9ce-b253771d23a1] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:56.009930 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-038efe39-f17e-4162-9a90-33d59b8238f3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:56.010424 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-038efe39-f17e-4162-9a90-33d59b8238f3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:56.011173 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-038efe39-f17e-4162-9a90-33d59b8238f3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:56.011622 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-038efe39-f17e-4162-9a90-33d59b8238f3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:56.146716 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-038efe39-f17e-4162-9a90-33d59b8238f3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:56.154591 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-038efe39-f17e-4162-9a90-33d59b8238f3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1" status: 200 len: 1522 microversion: 2.1 time: 0.155751 May 26 15:10:56.155180 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 144/321] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:55 2022] GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:57.172494 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-8050e91b-3fd4-4d05-a0c1-317dddffe144 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:57.173119 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-8050e91b-3fd4-4d05-a0c1-317dddffe144 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: ab471a8e-c724-4c71-b9ce-b253771d23a1] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:57.179071 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8050e91b-3fd4-4d05-a0c1-317dddffe144 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:57.179533 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8050e91b-3fd4-4d05-a0c1-317dddffe144 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:57.180282 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8050e91b-3fd4-4d05-a0c1-317dddffe144 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:57.180703 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8050e91b-3fd4-4d05-a0c1-317dddffe144 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:57.313874 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-8050e91b-3fd4-4d05-a0c1-317dddffe144 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:57.321400 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-8050e91b-3fd4-4d05-a0c1-317dddffe144 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1" status: 200 len: 1522 microversion: 2.1 time: 0.153288 May 26 15:10:57.321968 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 178/322] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:57 2022] GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:58.337643 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-6e5b0da3-1e84-47ee-9257-3bd70e57483c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:58.338243 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-6e5b0da3-1e84-47ee-9257-3bd70e57483c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: ab471a8e-c724-4c71-b9ce-b253771d23a1] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:58.340548 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=26 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:58.346478 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6e5b0da3-1e84-47ee-9257-3bd70e57483c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:58.346924 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6e5b0da3-1e84-47ee-9257-3bd70e57483c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:58.347713 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6e5b0da3-1e84-47ee-9257-3bd70e57483c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:58.348146 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6e5b0da3-1e84-47ee-9257-3bd70e57483c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:58.350935 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=76 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:58.498747 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6e5b0da3-1e84-47ee-9257-3bd70e57483c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:58.506719 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-6e5b0da3-1e84-47ee-9257-3bd70e57483c tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1" status: 200 len: 1522 microversion: 2.1 time: 0.172898 May 26 15:10:58.507327 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 145/323] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:58 2022] GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:59.524365 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-155f01d7-3f62-4ebe-afe7-21d6e789a198 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:59.524973 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-155f01d7-3f62-4ebe-afe7-21d6e789a198 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: ab471a8e-c724-4c71-b9ce-b253771d23a1] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:59.531738 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-155f01d7-3f62-4ebe-afe7-21d6e789a198 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:59.532189 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-155f01d7-3f62-4ebe-afe7-21d6e789a198 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:59.532949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-155f01d7-3f62-4ebe-afe7-21d6e789a198 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:59.533379 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-155f01d7-3f62-4ebe-afe7-21d6e789a198 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:59.660388 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-155f01d7-3f62-4ebe-afe7-21d6e789a198 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:59.667861 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-155f01d7-3f62-4ebe-afe7-21d6e789a198 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1" status: 200 len: 1522 microversion: 2.1 time: 0.147538 May 26 15:10:59.668431 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 179/324] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:10:59 2022] GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:00.684867 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-7cc40fab-eb46-4f6e-83e7-df75d41f2350 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:00.685461 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-7cc40fab-eb46-4f6e-83e7-df75d41f2350 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: ab471a8e-c724-4c71-b9ce-b253771d23a1] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:00.691921 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7cc40fab-eb46-4f6e-83e7-df75d41f2350 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:00.692367 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7cc40fab-eb46-4f6e-83e7-df75d41f2350 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:00.693133 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7cc40fab-eb46-4f6e-83e7-df75d41f2350 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:00.693567 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7cc40fab-eb46-4f6e-83e7-df75d41f2350 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:00.826330 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7cc40fab-eb46-4f6e-83e7-df75d41f2350 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:00.834023 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-7cc40fab-eb46-4f6e-83e7-df75d41f2350 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1" status: 200 len: 1522 microversion: 2.1 time: 0.153099 May 26 15:11:00.834594 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 146/325] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:11:00 2022] GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:01.850750 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-489f3b65-840b-413a-922a-49568c81d8c3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:01.851409 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-489f3b65-840b-413a-922a-49568c81d8c3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: ab471a8e-c724-4c71-b9ce-b253771d23a1] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:01.858793 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-489f3b65-840b-413a-922a-49568c81d8c3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:01.859266 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-489f3b65-840b-413a-922a-49568c81d8c3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:01.860027 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-489f3b65-840b-413a-922a-49568c81d8c3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:01.860458 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-489f3b65-840b-413a-922a-49568c81d8c3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:01.989646 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-489f3b65-840b-413a-922a-49568c81d8c3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:01.997109 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-489f3b65-840b-413a-922a-49568c81d8c3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1" status: 200 len: 1522 microversion: 2.1 time: 0.150114 May 26 15:11:01.997675 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 180/326] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:11:01 2022] GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:03.014236 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d92f7160-6165-4d80-b9bc-b5c9a666d353 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:03.014843 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-d92f7160-6165-4d80-b9bc-b5c9a666d353 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: ab471a8e-c724-4c71-b9ce-b253771d23a1] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:03.021647 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d92f7160-6165-4d80-b9bc-b5c9a666d353 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:03.022092 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d92f7160-6165-4d80-b9bc-b5c9a666d353 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:03.023130 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d92f7160-6165-4d80-b9bc-b5c9a666d353 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:03.023567 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d92f7160-6165-4d80-b9bc-b5c9a666d353 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:03.156328 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d92f7160-6165-4d80-b9bc-b5c9a666d353 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:03.163818 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-d92f7160-6165-4d80-b9bc-b5c9a666d353 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1" status: 200 len: 1522 microversion: 2.1 time: 0.153667 May 26 15:11:03.164377 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 147/327] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:11:03 2022] GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:04.181389 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-9587d0f5-9882-42ae-838f-58d856a8f33f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:04.181924 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-9587d0f5-9882-42ae-838f-58d856a8f33f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: ab471a8e-c724-4c71-b9ce-b253771d23a1] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:04.188441 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9587d0f5-9882-42ae-838f-58d856a8f33f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:04.188877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9587d0f5-9882-42ae-838f-58d856a8f33f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:04.189626 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9587d0f5-9882-42ae-838f-58d856a8f33f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:04.190048 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9587d0f5-9882-42ae-838f-58d856a8f33f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:04.323523 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-9587d0f5-9882-42ae-838f-58d856a8f33f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:04.331854 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-9587d0f5-9882-42ae-838f-58d856a8f33f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1" status: 200 len: 1522 microversion: 2.1 time: 0.154361 May 26 15:11:04.332491 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 181/328] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:11:04 2022] GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:05.348940 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-96ddfffe-3403-48f4-8122-fccd4cc2d385 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:05.349545 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-96ddfffe-3403-48f4-8122-fccd4cc2d385 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: ab471a8e-c724-4c71-b9ce-b253771d23a1] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:05.356078 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-96ddfffe-3403-48f4-8122-fccd4cc2d385 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:05.356521 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-96ddfffe-3403-48f4-8122-fccd4cc2d385 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:05.357507 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-96ddfffe-3403-48f4-8122-fccd4cc2d385 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:05.357980 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-96ddfffe-3403-48f4-8122-fccd4cc2d385 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:05.488892 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-96ddfffe-3403-48f4-8122-fccd4cc2d385 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:05.496486 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-96ddfffe-3403-48f4-8122-fccd4cc2d385 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1" status: 200 len: 1522 microversion: 2.1 time: 0.151361 May 26 15:11:05.497050 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 148/329] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:11:05 2022] GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:06.514230 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-fd000bfb-1a1b-4e3c-9568-fd5198224e99 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:06.514833 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-fd000bfb-1a1b-4e3c-9568-fd5198224e99 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: ab471a8e-c724-4c71-b9ce-b253771d23a1] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:06.520804 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fd000bfb-1a1b-4e3c-9568-fd5198224e99 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:06.521244 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fd000bfb-1a1b-4e3c-9568-fd5198224e99 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:06.522057 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fd000bfb-1a1b-4e3c-9568-fd5198224e99 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:06.522486 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fd000bfb-1a1b-4e3c-9568-fd5198224e99 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:06.656361 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-fd000bfb-1a1b-4e3c-9568-fd5198224e99 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:06.664142 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-fd000bfb-1a1b-4e3c-9568-fd5198224e99 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1" status: 200 len: 1522 microversion: 2.1 time: 0.154289 May 26 15:11:06.664724 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 182/330] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:11:06 2022] GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:07.681875 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-bea1ea4d-bb81-4210-8b2c-0d1366877457 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:07.682537 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-bea1ea4d-bb81-4210-8b2c-0d1366877457 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: ab471a8e-c724-4c71-b9ce-b253771d23a1] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:07.690063 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bea1ea4d-bb81-4210-8b2c-0d1366877457 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:07.690509 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bea1ea4d-bb81-4210-8b2c-0d1366877457 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:07.691327 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bea1ea4d-bb81-4210-8b2c-0d1366877457 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:07.691758 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bea1ea4d-bb81-4210-8b2c-0d1366877457 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:07.836955 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-bea1ea4d-bb81-4210-8b2c-0d1366877457 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:07.845119 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-bea1ea4d-bb81-4210-8b2c-0d1366877457 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1" status: 200 len: 1502 microversion: 2.1 time: 0.167069 May 26 15:11:07.845925 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 149/331] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:11:07 2022] GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1 => generated 1502 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:07.865026 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-c1d8404e-1c91-4713-8893-7716acdb5fe0 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6537c22a-6652-4985-b307-d0d81094f7c5"}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:11:07.866179 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-c1d8404e-1c91-4713-8893-7716acdb5fe0 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: ab471a8e-c724-4c71-b9ce-b253771d23a1] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:07.874724 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c1d8404e-1c91-4713-8893-7716acdb5fe0 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:07.875232 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c1d8404e-1c91-4713-8893-7716acdb5fe0 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:07.875973 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c1d8404e-1c91-4713-8893-7716acdb5fe0 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:07.876565 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c1d8404e-1c91-4713-8893-7716acdb5fe0 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:07.902825 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.wsgi [None req-c1d8404e-1c91-4713-8893-7716acdb5fe0 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] HTTP exception thrown: Cannot 'attach_volume' instance ab471a8e-c724-4c71-b9ce-b253771d23a1 while it is in vm_state rescued May 26 15:11:07.904603 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-c1d8404e-1c91-4713-8893-7716acdb5fe0 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Request method failure captured: May 26 15:11:07.904603 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: request: POST /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1/os-volume_attachments HTTP/1.1 May 26 15:11:07.904603 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept: application/json May 26 15:11:07.904603 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept-Encoding: identity May 26 15:11:07.904603 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Connection: close May 26 15:11:07.904603 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Length: 74 May 26 15:11:07.904603 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Type: application/json May 26 15:11:07.904603 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Host: 10.222.0.45 May 26 15:11:07.904603 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Openstack-System-Scope: None May 26 15:11:07.904603 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: User-Agent: python-urllib3/1.26.9 May 26 15:11:07.904603 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Auth-Token: gAAAAABij5gMlm5GpsxSW-5gFPLeSCTTSlLXjA9pJg4tHLzyoI_w98hI0aHKaaT7EayS7FvKHWCko4QlLuTbGjrbvwimGwYrU0rK44Sp3IWWOQnjEQh2Is81shN7a9UOyTdxs6LiujiFiQVD-wz53JvK2hkeV3IEn6BZKmbirZ2HujAlq8eqdqQ May 26 15:11:07.904603 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Id: None May 26 15:11:07.904603 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Name: None May 26 15:11:07.904603 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Identity-Status: Confirmed May 26 15:11:07.904603 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Is-Admin-Project: True May 26 15:11:07.904603 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Id: default May 26 15:11:07.904603 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Name: Default May 26 15:11:07.904603 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Id: bf95995343d547f78ae88a425f584ac7 May 26 15:11:07.904603 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1170690922 May 26 15:11:07.904603 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Role: reader,member May 26 15:11:07.904603 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Roles: reader,member May 26 15:11:07.906149 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bf95995343d547f78ae88a425f584ac7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bf95995343d547f78ae88a425f584ac7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/bf95995343d547f78ae88a425f584ac7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_bf95995343d547f78ae88a425f584ac7"}]}] May 26 15:11:07.906149 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1170690922 May 26 15:11:07.906149 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Id: bf95995343d547f78ae88a425f584ac7 May 26 15:11:07.906149 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1170690922 May 26 15:11:07.906149 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User: tempest-ServerRescueNegativeTestJSON-1170690922-project May 26 15:11:07.906149 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Id: default May 26 15:11:07.906149 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Name: Default May 26 15:11:07.906149 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Id: e29a5217495c41dda9564db96f6e36d1 May 26 15:11:07.906149 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1170690922-project May 26 15:11:07.906149 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: May 26 15:11:07.906149 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: {"volumeAttachment": {"volumeId": "6537c22a-6652-4985-b307-d0d81094f7c5"}} May 26 15:11:07.906149 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: method: > May 26 15:11:07.907115 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: exception: Cannot 'attach_volume' instance ab471a8e-c724-4c71-b9ce-b253771d23a1 while it is in vm_state rescued May 26 15:11:07.907115 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: action_args: {'server_id': 'ab471a8e-c724-4c71-b9ce-b253771d23a1', 'body': {'volumeAttachment': {'volumeId': '6537c22a-6652-4985-b307-d0d81094f7c5'}}} May 26 15:11:07.907115 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:11:07.907115 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:11:07.907115 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 15:11:07.907115 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 15:11:07.907115 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 15:11:07.907115 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 15:11:07.907115 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 26 15:11:07.907115 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 26 15:11:07.907115 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ab471a8e-c724-4c71-b9ce-b253771d23a1 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 26 15:11:07.907115 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:11:07.907115 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:11:07.907115 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:11:07.907115 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:11:07.907115 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:11:07.907115 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:11:07.907115 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:11:07.907115 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:11:07.908515 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:11:07.908515 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:11:07.908515 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 15:11:07.908515 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 15:11:07.908515 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 15:11:07.908515 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 15:11:07.908515 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 15:11:07.908515 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 15:11:07.908515 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 26 15:11:07.908515 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 26 15:11:07.908515 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 26 15:11:07.908515 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 26 15:11:07.908515 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ab471a8e-c724-4c71-b9ce-b253771d23a1 while it is in vm_state rescued May 26 15:11:07.908515 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:11:07.908515 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:11:07.908515 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:11:07.908515 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:11:07.908515 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:11:07.908515 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:11:07.909858 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:11:07.909858 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:11:07.909858 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ab471a8e-c724-4c71-b9ce-b253771d23a1 while it is in vm_state rescued May 26 15:11:07.909858 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:11:07.909858 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-c1d8404e-1c91-4713-8893-7716acdb5fe0 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Returning 409 to user: Cannot 'attach_volume' instance ab471a8e-c724-4c71-b9ce-b253771d23a1 while it is in vm_state rescued {{(pid=117799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:11:07.909858 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-c1d8404e-1c91-4713-8893-7716acdb5fe0 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "POST /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047312 May 26 15:11:07.909858 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 183/332] 10.222.0.45 () {60 vars in 1322 bytes} [Thu May 26 15:11:07 2022] POST /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1/os-volume_attachments => generated 152 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 26 15:11:07.915315 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-3bbbd7c3-4e62-4983-aa6a-c45db8b0faaf tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:11:07.915860 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-3bbbd7c3-4e62-4983-aa6a-c45db8b0faaf tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: ab471a8e-c724-4c71-b9ce-b253771d23a1] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:07.922758 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3bbbd7c3-4e62-4983-aa6a-c45db8b0faaf tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:07.923349 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3bbbd7c3-4e62-4983-aa6a-c45db8b0faaf tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:07.924135 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3bbbd7c3-4e62-4983-aa6a-c45db8b0faaf tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:07.924579 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3bbbd7c3-4e62-4983-aa6a-c45db8b0faaf tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:07.996623 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-3bbbd7c3-4e62-4983-aa6a-c45db8b0faaf tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "POST /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1/action" status: 202 len: 0 microversion: 2.1 time: 0.085087 May 26 15:11:08.000257 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 150/333] 10.222.0.45 () {60 vars in 1277 bytes} [Thu May 26 15:11:07 2022] POST /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 15:11:08.005497 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-88a34f86-b544-4eeb-9395-b41479a65654 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:08.006103 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-88a34f86-b544-4eeb-9395-b41479a65654 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: ab471a8e-c724-4c71-b9ce-b253771d23a1] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:08.012209 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-88a34f86-b544-4eeb-9395-b41479a65654 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:08.012661 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-88a34f86-b544-4eeb-9395-b41479a65654 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:08.014285 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-88a34f86-b544-4eeb-9395-b41479a65654 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:08.014737 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-88a34f86-b544-4eeb-9395-b41479a65654 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:08.161759 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-88a34f86-b544-4eeb-9395-b41479a65654 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:08.169309 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-88a34f86-b544-4eeb-9395-b41479a65654 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1" status: 200 len: 1510 microversion: 2.1 time: 0.167640 May 26 15:11:08.169887 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 184/334] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:11:08 2022] GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1 => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:09.187353 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-cb047ab9-3352-4c78-a2c8-14bf995cb489 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:09.188370 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-cb047ab9-3352-4c78-a2c8-14bf995cb489 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: ab471a8e-c724-4c71-b9ce-b253771d23a1] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:09.194743 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cb047ab9-3352-4c78-a2c8-14bf995cb489 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:09.195255 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cb047ab9-3352-4c78-a2c8-14bf995cb489 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:09.196064 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cb047ab9-3352-4c78-a2c8-14bf995cb489 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:09.196563 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cb047ab9-3352-4c78-a2c8-14bf995cb489 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:09.343013 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-cb047ab9-3352-4c78-a2c8-14bf995cb489 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:09.350892 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-cb047ab9-3352-4c78-a2c8-14bf995cb489 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1" status: 200 len: 1510 microversion: 2.1 time: 0.168881 May 26 15:11:09.351548 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 151/335] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:11:09 2022] GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1 => generated 1510 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:10.369775 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-009936f6-7dab-4f44-bfaf-dcdff53269e1 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:10.370464 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-009936f6-7dab-4f44-bfaf-dcdff53269e1 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: ab471a8e-c724-4c71-b9ce-b253771d23a1] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:10.380592 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-009936f6-7dab-4f44-bfaf-dcdff53269e1 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:10.381041 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-009936f6-7dab-4f44-bfaf-dcdff53269e1 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:10.384603 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-009936f6-7dab-4f44-bfaf-dcdff53269e1 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:10.385058 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-009936f6-7dab-4f44-bfaf-dcdff53269e1 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:10.570680 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-009936f6-7dab-4f44-bfaf-dcdff53269e1 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:10.582669 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-009936f6-7dab-4f44-bfaf-dcdff53269e1 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1" status: 200 len: 1510 microversion: 2.1 time: 0.217937 May 26 15:11:10.584215 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 185/336] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:11:10 2022] GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1 => generated 1510 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:11.613959 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-527db15b-345c-441d-bf19-c393aa92a1b6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:11.614653 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-527db15b-345c-441d-bf19-c393aa92a1b6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: ab471a8e-c724-4c71-b9ce-b253771d23a1] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:11.632592 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-527db15b-345c-441d-bf19-c393aa92a1b6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:11.633057 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-527db15b-345c-441d-bf19-c393aa92a1b6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:11.633882 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-527db15b-345c-441d-bf19-c393aa92a1b6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:11.634445 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-527db15b-345c-441d-bf19-c393aa92a1b6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:11.775850 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-527db15b-345c-441d-bf19-c393aa92a1b6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:11.783432 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-527db15b-345c-441d-bf19-c393aa92a1b6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1" status: 200 len: 1516 microversion: 2.1 time: 0.182847 May 26 15:11:11.784002 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 152/337] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:11:11 2022] GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1 => generated 1516 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:17.324706 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-ed0c5e9c-9dee-4d4a-b46f-216e8f9cf157 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Action: 'create', calling method: .version_select at 0x7ffb5d87da60>, body: {"keypair": {"name": "tempest-keypair-1119036631", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOD/dBORjQWt9bAUTSGHburQMzmyT9qGWKZQnF9FPf3b+tMWL0r5nXgJ5QEm/OFi3dzVcbswII/wyjuwYPqU/ZbcCRA9+yc32iUUFW6cDUdR8WgZISGSkGmSIiFLMwKUOA=="}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:11:17.338904 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.quota [None req-ed0c5e9c-9dee-4d4a-b46f-216e8f9cf157 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Getting quotas for project bf95995343d547f78ae88a425f584ac7. Resources: {'key_pairs'} {{(pid=117799) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:11:17.343636 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.quota [None req-ed0c5e9c-9dee-4d4a-b46f-216e8f9cf157 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Getting quotas for user e29a5217495c41dda9564db96f6e36d1 and project bf95995343d547f78ae88a425f584ac7. Resources: {'key_pairs'} {{(pid=117799) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:11:17.368128 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-ed0c5e9c-9dee-4d4a-b46f-216e8f9cf157 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047266 May 26 15:11:17.368795 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 186/338] 10.222.0.45 () {60 vars in 1158 bytes} [Thu May 26 15:11:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:11:18.670536 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-3ad2c2ee-dcf0-486a-916b-a07806d4cf0e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-358835215", "imageRef": "5b5a68b4-38e3-4f05-b97f-4339d6752e34", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "639bd4c7-71e6-45c0-99da-922ed21622da"}], "security_groups": [{"name": "tempest-securitygroup--1484430497"}], "key_name": "tempest-keypair-1119036631", "user_data": "}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:11:18.775603 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.network.neutron [None req-3ad2c2ee-dcf0-486a-916b-a07806d4cf0e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] validate_networks() for [('639bd4c7-71e6-45c0-99da-922ed21622da', None, None, None, None, None)] {{(pid=117798) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:11:19.163750 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-3ad2c2ee-dcf0-486a-916b-a07806d4cf0e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Flavor limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:11:19.164175 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-3ad2c2ee-dcf0-486a-916b-a07806d4cf0e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Image limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:11:19.164646 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-3ad2c2ee-dcf0-486a-916b-a07806d4cf0e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Flavor pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:11:19.165056 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-3ad2c2ee-dcf0-486a-916b-a07806d4cf0e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Image pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:11:19.165496 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-3ad2c2ee-dcf0-486a-916b-a07806d4cf0e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:11:19.174587 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3ad2c2ee-dcf0-486a-916b-a07806d4cf0e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:19.175031 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3ad2c2ee-dcf0-486a-916b-a07806d4cf0e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:19.175893 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3ad2c2ee-dcf0-486a-916b-a07806d4cf0e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:19.176328 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3ad2c2ee-dcf0-486a-916b-a07806d4cf0e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:19.194588 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-3ad2c2ee-dcf0-486a-916b-a07806d4cf0e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Getting quotas for project bf95995343d547f78ae88a425f584ac7. Resources: {'cores', 'ram', 'instances'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:11:19.198652 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-3ad2c2ee-dcf0-486a-916b-a07806d4cf0e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Getting quotas for user e29a5217495c41dda9564db96f6e36d1 and project bf95995343d547f78ae88a425f584ac7. Resources: {'cores', 'ram', 'instances'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:11:19.211021 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-3ad2c2ee-dcf0-486a-916b-a07806d4cf0e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Going to run 1 instances... {{(pid=117798) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:11:19.213323 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-3ad2c2ee-dcf0-486a-916b-a07806d4cf0e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5b5a68b4-38e3-4f05-b97f-4339d6752e34',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:11:19.260391 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-3ad2c2ee-dcf0-486a-916b-a07806d4cf0e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.594208 May 26 15:11:19.261047 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 153/339] 10.222.0.45 () {60 vars in 1146 bytes} [Thu May 26 15:11:18 2022] POST /compute/v2.1/servers => generated 409 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 15:11:19.271398 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-8f153a2a-67d9-466a-91c0-9be0cbcd154d tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:19.272017 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-8f153a2a-67d9-466a-91c0-9be0cbcd154d tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:19.324283 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-8f153a2a-67d9-466a-91c0-9be0cbcd154d tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:19.331345 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-8f153a2a-67d9-466a-91c0-9be0cbcd154d tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1245 microversion: 2.1 time: 0.063936 May 26 15:11:19.332071 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 187/340] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:11:19 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1245 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:20.350464 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-38bce4bb-0239-4720-9111-d17c437f1419 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:20.352770 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-38bce4bb-0239-4720-9111-d17c437f1419 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:20.361187 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-38bce4bb-0239-4720-9111-d17c437f1419 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:20.362041 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-38bce4bb-0239-4720-9111-d17c437f1419 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:20.363255 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-38bce4bb-0239-4720-9111-d17c437f1419 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:20.365398 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-38bce4bb-0239-4720-9111-d17c437f1419 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:20.471784 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-38bce4bb-0239-4720-9111-d17c437f1419 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:20.493773 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-38bce4bb-0239-4720-9111-d17c437f1419 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1315 microversion: 2.1 time: 0.148855 May 26 15:11:20.496672 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 154/341] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:11:20 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:21.523717 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-72f91edb-e80e-45f2-9e97-823813820b42 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:21.525080 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-72f91edb-e80e-45f2-9e97-823813820b42 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:21.532340 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=57 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:21.534705 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-72f91edb-e80e-45f2-9e97-823813820b42 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:21.535435 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-72f91edb-e80e-45f2-9e97-823813820b42 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:21.536666 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-72f91edb-e80e-45f2-9e97-823813820b42 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:21.537347 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-72f91edb-e80e-45f2-9e97-823813820b42 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:21.771063 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-72f91edb-e80e-45f2-9e97-823813820b42 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:21.783615 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-72f91edb-e80e-45f2-9e97-823813820b42 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1371 microversion: 2.1 time: 0.269473 May 26 15:11:21.795810 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 188/342] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:11:21 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1371 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:22.410958 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-04f1831d-6a53-41b3-98a4-618b3586693e req-a4d76458-d37b-437d-b98d-89786820106c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b", "tag": "cb40c287-1f0d-473f-ac8a-df78c43b1820"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:11:22.455261 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-04f1831d-6a53-41b3-98a4-618b3586693e req-a4d76458-d37b-437d-b98d-89786820106c service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:22.455569 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-04f1831d-6a53-41b3-98a4-618b3586693e req-a4d76458-d37b-437d-b98d-89786820106c service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:22.484808 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-04f1831d-6a53-41b3-98a4-618b3586693e req-a4d76458-d37b-437d-b98d-89786820106c service nova] Creating event network-changed:cb40c287-1f0d-473f-ac8a-df78c43b1820 for instance b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b on hv-cinder-84301 May 26 15:11:22.494409 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-04f1831d-6a53-41b3-98a4-618b3586693e req-a4d76458-d37b-437d-b98d-89786820106c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089200 May 26 15:11:22.494994 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 155/343] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:11:22.804496 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-d5c3a204-35b7-4885-ae0f-599de97a7645 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:22.805925 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-d5c3a204-35b7-4885-ae0f-599de97a7645 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:22.813678 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:22.816536 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d5c3a204-35b7-4885-ae0f-599de97a7645 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:22.817491 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d5c3a204-35b7-4885-ae0f-599de97a7645 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:22.818430 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d5c3a204-35b7-4885-ae0f-599de97a7645 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:22.819023 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d5c3a204-35b7-4885-ae0f-599de97a7645 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:23.017710 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-d5c3a204-35b7-4885-ae0f-599de97a7645 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:23.029576 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-d5c3a204-35b7-4885-ae0f-599de97a7645 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1371 microversion: 2.1 time: 0.230792 May 26 15:11:23.044471 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 189/344] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:11:22 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1371 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:24.053114 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-14653c8b-5dfa-45de-ae8c-e9c5641bc23a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:24.055867 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-14653c8b-5dfa-45de-ae8c-e9c5641bc23a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:24.065776 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-14653c8b-5dfa-45de-ae8c-e9c5641bc23a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:24.066549 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-14653c8b-5dfa-45de-ae8c-e9c5641bc23a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:24.067844 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-14653c8b-5dfa-45de-ae8c-e9c5641bc23a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:24.068361 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-14653c8b-5dfa-45de-ae8c-e9c5641bc23a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:24.321623 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-14653c8b-5dfa-45de-ae8c-e9c5641bc23a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:24.330630 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-14653c8b-5dfa-45de-ae8c-e9c5641bc23a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1371 microversion: 2.1 time: 0.283424 May 26 15:11:24.335795 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 156/345] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:11:24 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1371 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:25.360431 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-ba60ca5c-726c-4bea-8570-b92f3c774a3e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:25.362644 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-ba60ca5c-726c-4bea-8570-b92f3c774a3e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:25.372966 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ba60ca5c-726c-4bea-8570-b92f3c774a3e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:25.373966 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ba60ca5c-726c-4bea-8570-b92f3c774a3e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:25.375404 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ba60ca5c-726c-4bea-8570-b92f3c774a3e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:25.376400 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ba60ca5c-726c-4bea-8570-b92f3c774a3e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:25.703150 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-ba60ca5c-726c-4bea-8570-b92f3c774a3e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:25.729975 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-ba60ca5c-726c-4bea-8570-b92f3c774a3e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1371 microversion: 2.1 time: 0.374486 May 26 15:11:25.744675 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 190/346] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:11:25 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1371 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:26.760242 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-0439dbc6-1da8-4502-83c7-8553d7569864 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:26.763077 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-0439dbc6-1da8-4502-83c7-8553d7569864 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:26.770332 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0439dbc6-1da8-4502-83c7-8553d7569864 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:26.770781 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0439dbc6-1da8-4502-83c7-8553d7569864 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:26.771588 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0439dbc6-1da8-4502-83c7-8553d7569864 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:26.772026 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0439dbc6-1da8-4502-83c7-8553d7569864 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:27.020713 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-0439dbc6-1da8-4502-83c7-8553d7569864 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:27.034013 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-0439dbc6-1da8-4502-83c7-8553d7569864 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1371 microversion: 2.1 time: 0.277472 May 26 15:11:27.035301 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 157/347] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:11:26 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1371 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:28.060342 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-3deea233-a2ae-4df3-8c28-7408389c2477 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:28.061227 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-3deea233-a2ae-4df3-8c28-7408389c2477 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:28.067932 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-3deea233-a2ae-4df3-8c28-7408389c2477 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:28.068675 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-3deea233-a2ae-4df3-8c28-7408389c2477 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:28.069663 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-3deea233-a2ae-4df3-8c28-7408389c2477 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:28.070346 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-3deea233-a2ae-4df3-8c28-7408389c2477 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:28.249539 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-3deea233-a2ae-4df3-8c28-7408389c2477 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:28.258723 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-3deea233-a2ae-4df3-8c28-7408389c2477 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1371 microversion: 2.1 time: 0.202838 May 26 15:11:28.268884 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 191/348] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:11:28 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1371 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:29.275952 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b3d24a97-f1a4-47ce-b0a1-8b9a425d24b8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:29.276573 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b3d24a97-f1a4-47ce-b0a1-8b9a425d24b8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:29.279120 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=2 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:29.280075 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=6 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:29.281018 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:29.287035 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b3d24a97-f1a4-47ce-b0a1-8b9a425d24b8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:29.287929 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b3d24a97-f1a4-47ce-b0a1-8b9a425d24b8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:29.289834 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b3d24a97-f1a4-47ce-b0a1-8b9a425d24b8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:29.290456 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b3d24a97-f1a4-47ce-b0a1-8b9a425d24b8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:29.296338 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:29.488223 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b3d24a97-f1a4-47ce-b0a1-8b9a425d24b8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:29.505549 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b3d24a97-f1a4-47ce-b0a1-8b9a425d24b8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1371 microversion: 2.1 time: 0.226975 May 26 15:11:29.505549 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 158/349] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:11:29 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1371 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:30.514995 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell0:SELECT=6 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:30.519680 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-4ee20a16-67ac-44c0-802c-f63e997a1d35 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:30.520297 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-4ee20a16-67ac-44c0-802c-f63e997a1d35 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:30.527161 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4ee20a16-67ac-44c0-802c-f63e997a1d35 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:30.527614 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4ee20a16-67ac-44c0-802c-f63e997a1d35 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:30.528944 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4ee20a16-67ac-44c0-802c-f63e997a1d35 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:30.529958 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4ee20a16-67ac-44c0-802c-f63e997a1d35 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:30.753026 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-4ee20a16-67ac-44c0-802c-f63e997a1d35 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:30.763122 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-4ee20a16-67ac-44c0-802c-f63e997a1d35 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1371 microversion: 2.1 time: 0.247422 May 26 15:11:30.773659 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 192/350] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:11:30 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1371 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:31.784925 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-5b247284-11ee-4510-81e7-0304baef6e42 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:31.786151 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-5b247284-11ee-4510-81e7-0304baef6e42 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:31.795431 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5b247284-11ee-4510-81e7-0304baef6e42 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:31.796284 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5b247284-11ee-4510-81e7-0304baef6e42 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:31.797309 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5b247284-11ee-4510-81e7-0304baef6e42 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:31.797802 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5b247284-11ee-4510-81e7-0304baef6e42 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:31.988874 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-5b247284-11ee-4510-81e7-0304baef6e42 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:32.001790 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-5b247284-11ee-4510-81e7-0304baef6e42 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1371 microversion: 2.1 time: 0.223828 May 26 15:11:32.007571 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 159/351] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:11:31 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:33.046328 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-da39e430-42b7-4f84-8ac4-4b2989378188 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:33.051821 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-da39e430-42b7-4f84-8ac4-4b2989378188 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:33.062316 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-da39e430-42b7-4f84-8ac4-4b2989378188 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:33.062762 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-da39e430-42b7-4f84-8ac4-4b2989378188 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:33.064378 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-da39e430-42b7-4f84-8ac4-4b2989378188 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:33.065000 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-da39e430-42b7-4f84-8ac4-4b2989378188 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:33.534370 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-da39e430-42b7-4f84-8ac4-4b2989378188 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:33.545035 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-da39e430-42b7-4f84-8ac4-4b2989378188 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1371 microversion: 2.1 time: 0.528587 May 26 15:11:33.549792 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 193/352] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:11:33 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1371 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:34.563179 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-590dab7f-fbf1-4edd-89eb-5fc13c6e7d7b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:34.564011 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-590dab7f-fbf1-4edd-89eb-5fc13c6e7d7b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:34.575509 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-590dab7f-fbf1-4edd-89eb-5fc13c6e7d7b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:34.576005 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-590dab7f-fbf1-4edd-89eb-5fc13c6e7d7b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:34.581971 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-590dab7f-fbf1-4edd-89eb-5fc13c6e7d7b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:34.585363 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-590dab7f-fbf1-4edd-89eb-5fc13c6e7d7b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:34.957283 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-590dab7f-fbf1-4edd-89eb-5fc13c6e7d7b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:34.977468 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-590dab7f-fbf1-4edd-89eb-5fc13c6e7d7b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1371 microversion: 2.1 time: 0.418833 May 26 15:11:34.978200 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 160/353] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:11:34 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1371 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:35.996330 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-90478bfd-f53a-4eaf-91d4-1cae31a6b0d6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:36.000084 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-90478bfd-f53a-4eaf-91d4-1cae31a6b0d6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:36.008760 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-90478bfd-f53a-4eaf-91d4-1cae31a6b0d6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:36.009212 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-90478bfd-f53a-4eaf-91d4-1cae31a6b0d6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:36.010142 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-90478bfd-f53a-4eaf-91d4-1cae31a6b0d6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:36.010583 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-90478bfd-f53a-4eaf-91d4-1cae31a6b0d6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:36.125129 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-833e64f1-b8a3-4787-98c9-9de587db12a0 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Action: 'create', calling method: .version_select at 0x7ffb5d80db80>, body: {"keypair": {"name": "tempest-TestShelveInstance-519972658", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcTAynTZRwuZwiFfMR95cPsSYDTY4CNlLuCgqYrovmgRdH4pdIJf2SIg95U1FOAYE0/2aL5uSCmWXR8EuQoElK56QKQOTvxm2kDmJnTIOQbLSxmoGc0nO7g9ziAnVIMHg=="}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:11:36.153090 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.quota [None req-833e64f1-b8a3-4787-98c9-9de587db12a0 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Getting quotas for project 070367cab3334be48e0644598d755492. Resources: {'key_pairs'} {{(pid=117799) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:11:36.157862 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.quota [None req-833e64f1-b8a3-4787-98c9-9de587db12a0 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Getting quotas for user c861e4c9be0b4e7ab86df8ec362013f1 and project 070367cab3334be48e0644598d755492. Resources: {'key_pairs'} {{(pid=117799) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:11:36.158507 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-90478bfd-f53a-4eaf-91d4-1cae31a6b0d6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:36.165839 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-90478bfd-f53a-4eaf-91d4-1cae31a6b0d6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1371 microversion: 2.1 time: 0.173464 May 26 15:11:36.166413 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 161/354] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:11:35 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:11:36.187851 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-833e64f1-b8a3-4787-98c9-9de587db12a0 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.295881 May 26 15:11:36.188446 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 194/355] 10.222.0.45 () {60 vars in 1158 bytes} [Thu May 26 15:11:35 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:11:37.185624 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c015c943-492a-4cd1-a08b-4607fd923608 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:37.186133 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c015c943-492a-4cd1-a08b-4607fd923608 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:37.195374 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c015c943-492a-4cd1-a08b-4607fd923608 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:37.196354 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c015c943-492a-4cd1-a08b-4607fd923608 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:37.203287 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c015c943-492a-4cd1-a08b-4607fd923608 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:37.204087 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c015c943-492a-4cd1-a08b-4607fd923608 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:37.407482 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c015c943-492a-4cd1-a08b-4607fd923608 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:37.421689 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c015c943-492a-4cd1-a08b-4607fd923608 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1371 microversion: 2.1 time: 0.241825 May 26 15:11:37.422278 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 162/356] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:11:37 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1371 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:38.271987 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-e265d934-57fd-41e2-9dbb-a5a993d3fc13 req-36edb92e-422f-4679-9bc7-a6281c53fbc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b", "name": "network-vif-plugged", "status": "completed", "tag": "cb40c287-1f0d-473f-ac8a-df78c43b1820"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:11:38.282018 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-e265d934-57fd-41e2-9dbb-a5a993d3fc13 req-36edb92e-422f-4679-9bc7-a6281c53fbc7 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:38.282637 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-e265d934-57fd-41e2-9dbb-a5a993d3fc13 req-36edb92e-422f-4679-9bc7-a6281c53fbc7 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:38.296469 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-e265d934-57fd-41e2-9dbb-a5a993d3fc13 req-36edb92e-422f-4679-9bc7-a6281c53fbc7 service nova] Creating event network-vif-plugged:cb40c287-1f0d-473f-ac8a-df78c43b1820 for instance b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b on hv-cinder-84301 May 26 15:11:38.302178 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-e265d934-57fd-41e2-9dbb-a5a993d3fc13 req-36edb92e-422f-4679-9bc7-a6281c53fbc7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033956 May 26 15:11:38.302854 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 195/357] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:11:38.439647 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-69967461-e5da-43e1-924c-d30eaf9dc548 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:38.441267 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-69967461-e5da-43e1-924c-d30eaf9dc548 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:38.451555 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-69967461-e5da-43e1-924c-d30eaf9dc548 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:38.452336 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-69967461-e5da-43e1-924c-d30eaf9dc548 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:38.453428 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-69967461-e5da-43e1-924c-d30eaf9dc548 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:38.454065 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-69967461-e5da-43e1-924c-d30eaf9dc548 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:38.623890 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-69967461-e5da-43e1-924c-d30eaf9dc548 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:38.649866 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-69967461-e5da-43e1-924c-d30eaf9dc548 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1371 microversion: 2.1 time: 0.215489 May 26 15:11:38.664305 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 163/358] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:11:38 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1371 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:39.672721 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-5a47af3b-99ac-4c9f-a33e-3e27671dd3be tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:39.673971 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-5a47af3b-99ac-4c9f-a33e-3e27671dd3be tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:39.684166 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5a47af3b-99ac-4c9f-a33e-3e27671dd3be tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:39.684921 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5a47af3b-99ac-4c9f-a33e-3e27671dd3be tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:39.685634 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5a47af3b-99ac-4c9f-a33e-3e27671dd3be tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:39.686676 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5a47af3b-99ac-4c9f-a33e-3e27671dd3be tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:39.882413 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-5a47af3b-99ac-4c9f-a33e-3e27671dd3be tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:39.895422 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-5a47af3b-99ac-4c9f-a33e-3e27671dd3be tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1371 microversion: 2.1 time: 0.227706 May 26 15:11:39.896116 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 196/359] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:11:39 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1371 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:40.913840 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-cf8b72f0-568f-4255-8ae4-533a0d7b09a4 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:40.914446 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-cf8b72f0-568f-4255-8ae4-533a0d7b09a4 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:40.921927 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cf8b72f0-568f-4255-8ae4-533a0d7b09a4 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:40.922375 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cf8b72f0-568f-4255-8ae4-533a0d7b09a4 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:40.923165 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cf8b72f0-568f-4255-8ae4-533a0d7b09a4 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:40.923600 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cf8b72f0-568f-4255-8ae4-533a0d7b09a4 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:41.074294 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-cf8b72f0-568f-4255-8ae4-533a0d7b09a4 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:41.082707 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-cf8b72f0-568f-4255-8ae4-533a0d7b09a4 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1371 microversion: 2.1 time: 0.172657 May 26 15:11:41.083305 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 164/360] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:11:40 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:42.100456 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-0a2c9af2-3987-4e65-9bb4-a455eb631e53 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:42.101065 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-0a2c9af2-3987-4e65-9bb4-a455eb631e53 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:42.107896 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0a2c9af2-3987-4e65-9bb4-a455eb631e53 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:42.108352 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0a2c9af2-3987-4e65-9bb4-a455eb631e53 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:42.109120 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0a2c9af2-3987-4e65-9bb4-a455eb631e53 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:42.109551 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0a2c9af2-3987-4e65-9bb4-a455eb631e53 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:42.239810 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-0a2c9af2-3987-4e65-9bb4-a455eb631e53 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:42.247277 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-0a2c9af2-3987-4e65-9bb4-a455eb631e53 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1371 microversion: 2.1 time: 0.150662 May 26 15:11:42.247849 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 197/361] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:11:42 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:43.263999 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-aeb40af7-143f-4f7b-8231-5f7cef842fe9 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:43.264656 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-aeb40af7-143f-4f7b-8231-5f7cef842fe9 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:43.271699 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-aeb40af7-143f-4f7b-8231-5f7cef842fe9 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:43.272322 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-aeb40af7-143f-4f7b-8231-5f7cef842fe9 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:43.273095 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-aeb40af7-143f-4f7b-8231-5f7cef842fe9 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:43.273524 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-aeb40af7-143f-4f7b-8231-5f7cef842fe9 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:43.451945 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-aeb40af7-143f-4f7b-8231-5f7cef842fe9 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:43.465969 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-aeb40af7-143f-4f7b-8231-5f7cef842fe9 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1371 microversion: 2.1 time: 0.204886 May 26 15:11:43.467123 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 165/362] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:11:43 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1371 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:44.484279 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-f5332128-8595-4747-b797-e0306cdcf357 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:44.484879 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-f5332128-8595-4747-b797-e0306cdcf357 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:44.491164 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f5332128-8595-4747-b797-e0306cdcf357 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:44.491616 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f5332128-8595-4747-b797-e0306cdcf357 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:44.492406 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f5332128-8595-4747-b797-e0306cdcf357 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:44.492832 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f5332128-8595-4747-b797-e0306cdcf357 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:44.648541 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-f5332128-8595-4747-b797-e0306cdcf357 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:44.657559 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-f5332128-8595-4747-b797-e0306cdcf357 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1371 microversion: 2.1 time: 0.178403 May 26 15:11:44.658129 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 198/363] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:11:44 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:45.674785 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-43d08a95-8d48-42e3-a7d2-24534b530bf1 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:45.675549 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-43d08a95-8d48-42e3-a7d2-24534b530bf1 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:45.683257 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-43d08a95-8d48-42e3-a7d2-24534b530bf1 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:45.684242 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-43d08a95-8d48-42e3-a7d2-24534b530bf1 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:45.685605 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-43d08a95-8d48-42e3-a7d2-24534b530bf1 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:45.686106 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-43d08a95-8d48-42e3-a7d2-24534b530bf1 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:45.820780 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-43d08a95-8d48-42e3-a7d2-24534b530bf1 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:45.829203 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-43d08a95-8d48-42e3-a7d2-24534b530bf1 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1371 microversion: 2.1 time: 0.159035 May 26 15:11:45.829775 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 166/364] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:11:45 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:46.847706 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-58fdfe9a-35e3-46fe-9a42-62f48fcf6b01 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:46.848323 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-58fdfe9a-35e3-46fe-9a42-62f48fcf6b01 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:46.850359 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell0:SELECT=4 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:46.856119 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-58fdfe9a-35e3-46fe-9a42-62f48fcf6b01 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:46.856525 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-58fdfe9a-35e3-46fe-9a42-62f48fcf6b01 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:46.857307 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-58fdfe9a-35e3-46fe-9a42-62f48fcf6b01 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:46.857742 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-58fdfe9a-35e3-46fe-9a42-62f48fcf6b01 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:47.003969 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-58fdfe9a-35e3-46fe-9a42-62f48fcf6b01 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:47.012216 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-58fdfe9a-35e3-46fe-9a42-62f48fcf6b01 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1371 microversion: 2.1 time: 0.169457 May 26 15:11:47.013358 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 199/365] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:11:46 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:11:48.030065 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-46d46e59-002c-4fec-96f2-18653a105fc3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:48.030679 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-46d46e59-002c-4fec-96f2-18653a105fc3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:48.037569 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-46d46e59-002c-4fec-96f2-18653a105fc3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:48.038012 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-46d46e59-002c-4fec-96f2-18653a105fc3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:48.038785 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-46d46e59-002c-4fec-96f2-18653a105fc3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:48.039322 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-46d46e59-002c-4fec-96f2-18653a105fc3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:48.189105 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-46d46e59-002c-4fec-96f2-18653a105fc3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:48.197831 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-46d46e59-002c-4fec-96f2-18653a105fc3 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1371 microversion: 2.1 time: 0.171834 May 26 15:11:48.198512 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 167/366] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:11:48 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:49.214167 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-36134ae5-8d85-44d3-9c77-548ff35b9177 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:49.214779 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-36134ae5-8d85-44d3-9c77-548ff35b9177 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:49.221582 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-36134ae5-8d85-44d3-9c77-548ff35b9177 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:49.222029 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-36134ae5-8d85-44d3-9c77-548ff35b9177 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:49.222806 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-36134ae5-8d85-44d3-9c77-548ff35b9177 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:49.223348 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-36134ae5-8d85-44d3-9c77-548ff35b9177 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:49.355349 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-36134ae5-8d85-44d3-9c77-548ff35b9177 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:49.363830 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-36134ae5-8d85-44d3-9c77-548ff35b9177 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1371 microversion: 2.1 time: 0.153499 May 26 15:11:49.364454 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 200/367] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:11:49 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:50.381078 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-2e018349-15f7-45b6-9364-624fc90092d0 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:50.381689 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-2e018349-15f7-45b6-9364-624fc90092d0 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:50.388650 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2e018349-15f7-45b6-9364-624fc90092d0 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:50.389125 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2e018349-15f7-45b6-9364-624fc90092d0 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:50.389908 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2e018349-15f7-45b6-9364-624fc90092d0 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:50.390337 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2e018349-15f7-45b6-9364-624fc90092d0 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:50.530189 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2e018349-15f7-45b6-9364-624fc90092d0 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:50.540137 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-2e018349-15f7-45b6-9364-624fc90092d0 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1371 microversion: 2.1 time: 0.162856 May 26 15:11:50.540761 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 168/368] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:11:50 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:51.558277 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-d01f1b65-6df2-4390-aeba-63bd05676887 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:51.560085 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-d01f1b65-6df2-4390-aeba-63bd05676887 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:51.566489 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d01f1b65-6df2-4390-aeba-63bd05676887 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:51.566925 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d01f1b65-6df2-4390-aeba-63bd05676887 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:51.567723 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d01f1b65-6df2-4390-aeba-63bd05676887 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:51.568172 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d01f1b65-6df2-4390-aeba-63bd05676887 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:51.570913 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=69 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:51.704737 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-d01f1b65-6df2-4390-aeba-63bd05676887 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:51.712271 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-d01f1b65-6df2-4390-aeba-63bd05676887 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1371 microversion: 2.1 time: 0.157802 May 26 15:11:51.712840 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 201/369] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:11:51 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:52.729667 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-00b4ceea-b5cb-4462-b3ff-2b58ea7870ba tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:52.730791 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-00b4ceea-b5cb-4462-b3ff-2b58ea7870ba tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:52.737211 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-00b4ceea-b5cb-4462-b3ff-2b58ea7870ba tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:52.737744 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-00b4ceea-b5cb-4462-b3ff-2b58ea7870ba tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:52.738589 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-00b4ceea-b5cb-4462-b3ff-2b58ea7870ba tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:52.739028 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-00b4ceea-b5cb-4462-b3ff-2b58ea7870ba tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:52.878056 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-00b4ceea-b5cb-4462-b3ff-2b58ea7870ba tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:52.885541 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-00b4ceea-b5cb-4462-b3ff-2b58ea7870ba tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1371 microversion: 2.1 time: 0.160026 May 26 15:11:52.886118 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 169/370] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:11:52 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:53.904214 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-8522cbb7-043f-46f1-bdad-3a6f9d84ceab tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:53.904835 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-8522cbb7-043f-46f1-bdad-3a6f9d84ceab tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:53.906689 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:53.922276 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8522cbb7-043f-46f1-bdad-3a6f9d84ceab tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:53.923644 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8522cbb7-043f-46f1-bdad-3a6f9d84ceab tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:53.924503 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8522cbb7-043f-46f1-bdad-3a6f9d84ceab tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:53.924942 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8522cbb7-043f-46f1-bdad-3a6f9d84ceab tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:54.148685 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-8522cbb7-043f-46f1-bdad-3a6f9d84ceab tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:54.157507 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-8522cbb7-043f-46f1-bdad-3a6f9d84ceab tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1371 microversion: 2.1 time: 0.257119 May 26 15:11:54.158244 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 202/371] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:11:53 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1371 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:55.174449 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f5cd6e66-a9a9-4c76-a6ac-beb59dbb0167 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:55.175325 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f5cd6e66-a9a9-4c76-a6ac-beb59dbb0167 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:55.182617 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f5cd6e66-a9a9-4c76-a6ac-beb59dbb0167 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:55.183064 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f5cd6e66-a9a9-4c76-a6ac-beb59dbb0167 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:55.184146 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f5cd6e66-a9a9-4c76-a6ac-beb59dbb0167 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:55.184672 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f5cd6e66-a9a9-4c76-a6ac-beb59dbb0167 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:55.337254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f5cd6e66-a9a9-4c76-a6ac-beb59dbb0167 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:55.346201 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f5cd6e66-a9a9-4c76-a6ac-beb59dbb0167 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1565 microversion: 2.1 time: 0.175987 May 26 15:11:55.349031 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 170/372] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:11:55 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1565 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:11:55.364535 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-13918284-9f7a-42b5-91b8-e7fed703bcb2 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:55.365442 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-13918284-9f7a-42b5-91b8-e7fed703bcb2 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:55.372824 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-13918284-9f7a-42b5-91b8-e7fed703bcb2 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:55.373602 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-13918284-9f7a-42b5-91b8-e7fed703bcb2 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:55.374959 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-13918284-9f7a-42b5-91b8-e7fed703bcb2 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:55.375962 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-13918284-9f7a-42b5-91b8-e7fed703bcb2 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:55.471340 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-13918284-9f7a-42b5-91b8-e7fed703bcb2 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110596 May 26 15:11:55.472105 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 203/373] 10.222.0.45 () {58 vars in 1274 bytes} [Thu May 26 15:11:55 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:11:56.869262 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-aec9d4c5-ff18-4463-9334-8c95e13d01d9 req-0a24844e-cec0-4752-a983-738c09626fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b", "tag": "cb40c287-1f0d-473f-ac8a-df78c43b1820"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:11:56.878254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-aec9d4c5-ff18-4463-9334-8c95e13d01d9 req-0a24844e-cec0-4752-a983-738c09626fd8 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:56.878773 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-aec9d4c5-ff18-4463-9334-8c95e13d01d9 req-0a24844e-cec0-4752-a983-738c09626fd8 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:56.892100 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-aec9d4c5-ff18-4463-9334-8c95e13d01d9 req-0a24844e-cec0-4752-a983-738c09626fd8 service nova] Creating event network-changed:cb40c287-1f0d-473f-ac8a-df78c43b1820 for instance b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b on hv-cinder-84301 May 26 15:11:56.897580 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-aec9d4c5-ff18-4463-9334-8c95e13d01d9 req-0a24844e-cec0-4752-a983-738c09626fd8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031738 May 26 15:11:56.898201 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 171/374] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:12:09.401192 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_api:SELECT=3 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:12:09.402187 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=15 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:12:09.406059 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-7abf26cb-bf98-4228-b598-124b38523839 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1155344150", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-519972658", "security_groups": [{"name": "tempest-secgroup-smoke-166623163"}], "networks": [{"uuid": "cc852c03-f055-4808-ac33-3fdf9f780929"}], "block_device_mapping_v2": [{"uuid": "faacae6a-49dc-4e91-9ef4-6ac3ac2430e1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:12:09.521564 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.network.neutron [None req-7abf26cb-bf98-4228-b598-124b38523839 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] validate_networks() for [('cc852c03-f055-4808-ac33-3fdf9f780929', None, None, None, None, None)] {{(pid=117799) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:12:09.895719 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-7abf26cb-bf98-4228-b598-124b38523839 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Flavor limits 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:12:09.896156 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-7abf26cb-bf98-4228-b598-124b38523839 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Image limits 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:12:09.896630 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-7abf26cb-bf98-4228-b598-124b38523839 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Flavor pref 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:12:09.897296 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-7abf26cb-bf98-4228-b598-124b38523839 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Image pref 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:12:09.897779 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-7abf26cb-bf98-4228-b598-124b38523839 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:12:09.906919 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7abf26cb-bf98-4228-b598-124b38523839 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:09.907386 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7abf26cb-bf98-4228-b598-124b38523839 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:09.908183 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7abf26cb-bf98-4228-b598-124b38523839 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:09.908616 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7abf26cb-bf98-4228-b598-124b38523839 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:09.927804 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.quota [None req-7abf26cb-bf98-4228-b598-124b38523839 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Getting quotas for project 070367cab3334be48e0644598d755492. Resources: {'cores', 'ram', 'instances'} {{(pid=117799) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:12:09.933855 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.quota [None req-7abf26cb-bf98-4228-b598-124b38523839 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Getting quotas for user c861e4c9be0b4e7ab86df8ec362013f1 and project 070367cab3334be48e0644598d755492. Resources: {'cores', 'ram', 'instances'} {{(pid=117799) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:12:09.996689 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-7abf26cb-bf98-4228-b598-124b38523839 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Going to run 1 instances... {{(pid=117799) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:12:09.998801 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-7abf26cb-bf98-4228-b598-124b38523839 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='faacae6a-49dc-4e91-9ef4-6ac3ac2430e1',volume_size=None,volume_type=None)] {{(pid=117799) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:12:10.133995 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-7abf26cb-bf98-4228-b598-124b38523839 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.733581 May 26 15:12:10.134645 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 204/375] 10.222.0.45 () {60 vars in 1146 bytes} [Thu May 26 15:12:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 15:12:10.143257 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=27 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:12:10.144137 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=79 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:12:10.148822 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-55abc656-311a-4767-9e2b-5a85e8a3ba94 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:10.149459 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-55abc656-311a-4767-9e2b-5a85e8a3ba94 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:10.428470 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-55abc656-311a-4767-9e2b-5a85e8a3ba94 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:10.435276 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-55abc656-311a-4767-9e2b-5a85e8a3ba94 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1088 microversion: 2.1 time: 0.293679 May 26 15:12:10.435843 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 172/376] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:12:10 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1088 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:12:11.452431 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-f30be9ed-a794-41d3-bec3-00f493842d18 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:11.452993 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-f30be9ed-a794-41d3-bec3-00f493842d18 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:11.505962 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-f30be9ed-a794-41d3-bec3-00f493842d18 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:11.513301 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-f30be9ed-a794-41d3-bec3-00f493842d18 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1088 microversion: 2.1 time: 0.064891 May 26 15:12:11.513863 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 205/377] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:12:11 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1088 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:12.532160 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-9c857fb2-89b2-437a-9466-9cc62d1b3338 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:12.532878 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-9c857fb2-89b2-437a-9466-9cc62d1b3338 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:12.588295 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-9c857fb2-89b2-437a-9466-9cc62d1b3338 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:12.596061 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-9c857fb2-89b2-437a-9466-9cc62d1b3338 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1088 microversion: 2.1 time: 0.068235 May 26 15:12:12.596672 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 173/378] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:12:12 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1088 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:13.613025 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-f1580f16-12e8-46c2-896c-6cd462e5d9c6 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:13.613633 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-f1580f16-12e8-46c2-896c-6cd462e5d9c6 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:13.620388 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f1580f16-12e8-46c2-896c-6cd462e5d9c6 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:13.621482 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f1580f16-12e8-46c2-896c-6cd462e5d9c6 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:13.622383 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f1580f16-12e8-46c2-896c-6cd462e5d9c6 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:13.622867 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f1580f16-12e8-46c2-896c-6cd462e5d9c6 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:13.687626 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-f1580f16-12e8-46c2-896c-6cd462e5d9c6 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:13.695240 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-f1580f16-12e8-46c2-896c-6cd462e5d9c6 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1138 microversion: 2.1 time: 0.085997 May 26 15:12:13.695849 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 206/379] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:12:13 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1138 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:14.713174 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a5e05924-a95b-4967-b363-67567064c45e tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:14.713799 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a5e05924-a95b-4967-b363-67567064c45e tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:14.721263 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a5e05924-a95b-4967-b363-67567064c45e tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:14.721745 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a5e05924-a95b-4967-b363-67567064c45e tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:14.722587 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a5e05924-a95b-4967-b363-67567064c45e tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:14.723055 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a5e05924-a95b-4967-b363-67567064c45e tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:14.794789 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a5e05924-a95b-4967-b363-67567064c45e tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:14.803314 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a5e05924-a95b-4967-b363-67567064c45e tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1130 microversion: 2.1 time: 0.094989 May 26 15:12:14.804010 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 174/380] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:12:14 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1130 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:15.822908 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-1aaf1b62-6bed-4987-b17e-fccdc3f3d2ed tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:15.824381 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-1aaf1b62-6bed-4987-b17e-fccdc3f3d2ed tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:15.833086 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1aaf1b62-6bed-4987-b17e-fccdc3f3d2ed tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:15.833597 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1aaf1b62-6bed-4987-b17e-fccdc3f3d2ed tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:15.834493 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1aaf1b62-6bed-4987-b17e-fccdc3f3d2ed tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:15.835128 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1aaf1b62-6bed-4987-b17e-fccdc3f3d2ed tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:15.916106 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-1aaf1b62-6bed-4987-b17e-fccdc3f3d2ed tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:15.926015 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-1aaf1b62-6bed-4987-b17e-fccdc3f3d2ed tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1204 microversion: 2.1 time: 0.107714 May 26 15:12:15.926613 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 207/381] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:12:15 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1204 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:16.754799 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-bb789b27-d6b5-4767-a2f1-30f79663bb2b req-d4786c23-ef4c-4246-a9cd-cec147ddf3af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e1f09bd-1e01-460e-be13-9b1749b27926", "tag": "6a458fb5-32cd-48f8-8aa2-9f2629863eb3"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:12:16.795967 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-bb789b27-d6b5-4767-a2f1-30f79663bb2b req-d4786c23-ef4c-4246-a9cd-cec147ddf3af service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:16.796979 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-bb789b27-d6b5-4767-a2f1-30f79663bb2b req-d4786c23-ef4c-4246-a9cd-cec147ddf3af service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:16.811784 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-bb789b27-d6b5-4767-a2f1-30f79663bb2b req-d4786c23-ef4c-4246-a9cd-cec147ddf3af service nova] Creating event network-changed:6a458fb5-32cd-48f8-8aa2-9f2629863eb3 for instance 4e1f09bd-1e01-460e-be13-9b1749b27926 on hv-cinder-84301 May 26 15:12:16.818011 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-bb789b27-d6b5-4767-a2f1-30f79663bb2b req-d4786c23-ef4c-4246-a9cd-cec147ddf3af service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067756 May 26 15:12:16.818870 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 175/382] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:12:16.951956 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-d8dcbdfb-9a94-47c3-8b8b-ac6e5d531ffe tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:16.952560 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-d8dcbdfb-9a94-47c3-8b8b-ac6e5d531ffe tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:16.958422 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d8dcbdfb-9a94-47c3-8b8b-ac6e5d531ffe tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:16.958867 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d8dcbdfb-9a94-47c3-8b8b-ac6e5d531ffe tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:16.959688 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d8dcbdfb-9a94-47c3-8b8b-ac6e5d531ffe tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:16.960198 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d8dcbdfb-9a94-47c3-8b8b-ac6e5d531ffe tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:17.098956 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-d8dcbdfb-9a94-47c3-8b8b-ac6e5d531ffe tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:17.107355 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-d8dcbdfb-9a94-47c3-8b8b-ac6e5d531ffe tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1259 microversion: 2.1 time: 0.161241 May 26 15:12:17.108033 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 208/383] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:12:16 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:18.125751 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-4c451d8c-02eb-4a46-b091-2e6f15a1f3f5 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:18.126443 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-4c451d8c-02eb-4a46-b091-2e6f15a1f3f5 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:18.133583 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4c451d8c-02eb-4a46-b091-2e6f15a1f3f5 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:18.134066 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4c451d8c-02eb-4a46-b091-2e6f15a1f3f5 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:18.134944 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4c451d8c-02eb-4a46-b091-2e6f15a1f3f5 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:18.135466 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4c451d8c-02eb-4a46-b091-2e6f15a1f3f5 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:18.283187 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-4c451d8c-02eb-4a46-b091-2e6f15a1f3f5 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:18.291737 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-4c451d8c-02eb-4a46-b091-2e6f15a1f3f5 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1259 microversion: 2.1 time: 0.170291 May 26 15:12:18.292454 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 176/384] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:12:18 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:19.310280 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-f8223eec-ce9a-4e86-b5d7-cb75644856a6 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:19.310905 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-f8223eec-ce9a-4e86-b5d7-cb75644856a6 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:19.317313 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f8223eec-ce9a-4e86-b5d7-cb75644856a6 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:19.317760 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f8223eec-ce9a-4e86-b5d7-cb75644856a6 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:19.318537 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f8223eec-ce9a-4e86-b5d7-cb75644856a6 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:19.318974 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f8223eec-ce9a-4e86-b5d7-cb75644856a6 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:19.453518 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-f8223eec-ce9a-4e86-b5d7-cb75644856a6 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:19.461016 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-f8223eec-ce9a-4e86-b5d7-cb75644856a6 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1259 microversion: 2.1 time: 0.155307 May 26 15:12:19.461591 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 209/385] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:12:19 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:20.478618 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-2cab803d-4d28-4b56-b2a6-c6f84bed4bf1 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:20.479192 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-2cab803d-4d28-4b56-b2a6-c6f84bed4bf1 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:20.485747 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2cab803d-4d28-4b56-b2a6-c6f84bed4bf1 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:20.486189 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2cab803d-4d28-4b56-b2a6-c6f84bed4bf1 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:20.486954 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2cab803d-4d28-4b56-b2a6-c6f84bed4bf1 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:20.487438 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2cab803d-4d28-4b56-b2a6-c6f84bed4bf1 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:20.625895 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2cab803d-4d28-4b56-b2a6-c6f84bed4bf1 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:20.633420 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-2cab803d-4d28-4b56-b2a6-c6f84bed4bf1 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1259 microversion: 2.1 time: 0.158740 May 26 15:12:20.633986 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 177/386] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:12:20 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:21.650967 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-8374b55d-ea87-40eb-b0a0-51547a3d539a tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:21.652273 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-8374b55d-ea87-40eb-b0a0-51547a3d539a tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:21.654289 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell0:SELECT=2 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:12:21.654974 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell0:SELECT=8 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:12:21.660735 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8374b55d-ea87-40eb-b0a0-51547a3d539a tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:21.661176 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8374b55d-ea87-40eb-b0a0-51547a3d539a tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:21.661941 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8374b55d-ea87-40eb-b0a0-51547a3d539a tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:21.662370 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8374b55d-ea87-40eb-b0a0-51547a3d539a tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:21.800618 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-8374b55d-ea87-40eb-b0a0-51547a3d539a tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:21.809122 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-8374b55d-ea87-40eb-b0a0-51547a3d539a tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1259 microversion: 2.1 time: 0.161774 May 26 15:12:21.809698 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 210/387] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:12:21 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:22.826951 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b2d800fc-b9a9-42b2-a490-716ddb4f4e77 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:22.827625 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b2d800fc-b9a9-42b2-a490-716ddb4f4e77 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:22.830189 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=4 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:12:22.836489 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b2d800fc-b9a9-42b2-a490-716ddb4f4e77 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:22.836940 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b2d800fc-b9a9-42b2-a490-716ddb4f4e77 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:22.837719 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b2d800fc-b9a9-42b2-a490-716ddb4f4e77 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:22.838156 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b2d800fc-b9a9-42b2-a490-716ddb4f4e77 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:22.981601 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b2d800fc-b9a9-42b2-a490-716ddb4f4e77 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:22.989427 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b2d800fc-b9a9-42b2-a490-716ddb4f4e77 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1259 microversion: 2.1 time: 0.167243 May 26 15:12:22.990021 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 178/388] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:12:22 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:24.007508 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-76d88846-238e-4482-8bcb-f6449763728c tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:24.008077 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-76d88846-238e-4482-8bcb-f6449763728c tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:24.014770 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-76d88846-238e-4482-8bcb-f6449763728c tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:24.015258 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-76d88846-238e-4482-8bcb-f6449763728c tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:24.016030 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-76d88846-238e-4482-8bcb-f6449763728c tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:24.016457 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-76d88846-238e-4482-8bcb-f6449763728c tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:24.177229 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-76d88846-238e-4482-8bcb-f6449763728c tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:24.185219 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-76d88846-238e-4482-8bcb-f6449763728c tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1259 microversion: 2.1 time: 0.181887 May 26 15:12:24.186006 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 211/389] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:12:24 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1259 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:25.203047 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-0ab5aa30-5c1a-4e2c-b3ea-5743b917b5e6 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:25.203833 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-0ab5aa30-5c1a-4e2c-b3ea-5743b917b5e6 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:25.210743 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0ab5aa30-5c1a-4e2c-b3ea-5743b917b5e6 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:25.211297 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0ab5aa30-5c1a-4e2c-b3ea-5743b917b5e6 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:25.212155 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0ab5aa30-5c1a-4e2c-b3ea-5743b917b5e6 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:25.212633 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0ab5aa30-5c1a-4e2c-b3ea-5743b917b5e6 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:25.372662 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-0ab5aa30-5c1a-4e2c-b3ea-5743b917b5e6 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:25.380334 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-0ab5aa30-5c1a-4e2c-b3ea-5743b917b5e6 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1259 microversion: 2.1 time: 0.182041 May 26 15:12:25.380929 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 179/390] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:12:25 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1259 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:26.397951 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-5b051934-5dfb-4b2a-ae8b-7352ae40403f tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:26.398570 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-5b051934-5dfb-4b2a-ae8b-7352ae40403f tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:26.406317 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5b051934-5dfb-4b2a-ae8b-7352ae40403f tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:26.406570 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5b051934-5dfb-4b2a-ae8b-7352ae40403f tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:26.407255 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5b051934-5dfb-4b2a-ae8b-7352ae40403f tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:26.407691 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5b051934-5dfb-4b2a-ae8b-7352ae40403f tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:26.554663 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-5b051934-5dfb-4b2a-ae8b-7352ae40403f tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:26.562778 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-5b051934-5dfb-4b2a-ae8b-7352ae40403f tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1259 microversion: 2.1 time: 0.168964 May 26 15:12:26.563389 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 212/391] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:12:26 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:27.580647 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-9f9a53b8-02c5-40fc-950b-394e43890d64 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:27.581310 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-9f9a53b8-02c5-40fc-950b-394e43890d64 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:27.587806 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9f9a53b8-02c5-40fc-950b-394e43890d64 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:27.588311 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9f9a53b8-02c5-40fc-950b-394e43890d64 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:27.589170 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9f9a53b8-02c5-40fc-950b-394e43890d64 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:27.589592 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9f9a53b8-02c5-40fc-950b-394e43890d64 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:27.732163 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-14466954-0c94-4a84-97e9-8d527c30b704 req-f4f9555e-98f4-43b4-abf0-f5038639373f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1f09bd-1e01-460e-be13-9b1749b27926", "name": "network-vif-plugged", "status": "completed", "tag": "6a458fb5-32cd-48f8-8aa2-9f2629863eb3"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:12:27.732722 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-9f9a53b8-02c5-40fc-950b-394e43890d64 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:27.742435 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-9f9a53b8-02c5-40fc-950b-394e43890d64 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1259 microversion: 2.1 time: 0.165423 May 26 15:12:27.743813 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 180/392] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:12:27 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:27.744372 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-14466954-0c94-4a84-97e9-8d527c30b704 req-f4f9555e-98f4-43b4-abf0-f5038639373f service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:27.745638 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-14466954-0c94-4a84-97e9-8d527c30b704 req-f4f9555e-98f4-43b4-abf0-f5038639373f service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:27.763645 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-14466954-0c94-4a84-97e9-8d527c30b704 req-f4f9555e-98f4-43b4-abf0-f5038639373f service nova] Creating event network-vif-plugged:6a458fb5-32cd-48f8-8aa2-9f2629863eb3 for instance 4e1f09bd-1e01-460e-be13-9b1749b27926 on hv-cinder-84301 May 26 15:12:27.768914 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-14466954-0c94-4a84-97e9-8d527c30b704 req-f4f9555e-98f4-43b4-abf0-f5038639373f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041485 May 26 15:12:27.769531 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 213/393] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:12:28.766523 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1aafdf73-80bc-42bd-86e6-fb1f2f36e7b7 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:28.767149 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1aafdf73-80bc-42bd-86e6-fb1f2f36e7b7 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:28.774017 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1aafdf73-80bc-42bd-86e6-fb1f2f36e7b7 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:28.774461 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1aafdf73-80bc-42bd-86e6-fb1f2f36e7b7 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:28.775258 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1aafdf73-80bc-42bd-86e6-fb1f2f36e7b7 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:28.775694 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1aafdf73-80bc-42bd-86e6-fb1f2f36e7b7 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:28.939168 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1aafdf73-80bc-42bd-86e6-fb1f2f36e7b7 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:28.946745 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1aafdf73-80bc-42bd-86e6-fb1f2f36e7b7 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1259 microversion: 2.1 time: 0.184089 May 26 15:12:28.947356 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 181/394] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:12:28 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1259 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:12:29.965900 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-15205422-f59d-4b79-af46-4770a0895add tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:29.966627 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-15205422-f59d-4b79-af46-4770a0895add tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:29.973381 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-15205422-f59d-4b79-af46-4770a0895add tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:29.973846 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-15205422-f59d-4b79-af46-4770a0895add tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:29.974627 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-15205422-f59d-4b79-af46-4770a0895add tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:29.975049 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-15205422-f59d-4b79-af46-4770a0895add tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:30.112680 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-15205422-f59d-4b79-af46-4770a0895add tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:30.121417 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-15205422-f59d-4b79-af46-4770a0895add tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1442 microversion: 2.1 time: 0.159467 May 26 15:12:30.121654 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 214/395] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:12:29 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1442 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:30.138822 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-40a62970-4c28-4d06-a590-677b23678851 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:30.139499 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-40a62970-4c28-4d06-a590-677b23678851 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:30.146091 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-40a62970-4c28-4d06-a590-677b23678851 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:30.146791 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-40a62970-4c28-4d06-a590-677b23678851 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:30.147585 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-40a62970-4c28-4d06-a590-677b23678851 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:30.148014 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-40a62970-4c28-4d06-a590-677b23678851 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:30.298241 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-40a62970-4c28-4d06-a590-677b23678851 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:30.306517 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-40a62970-4c28-4d06-a590-677b23678851 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1442 microversion: 2.1 time: 0.172236 May 26 15:12:30.307133 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 182/396] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:12:30 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1442 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:32.576395 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-789ea889-b3c8-4a10-a31c-1b995088e6bc req-3138718b-edb0-4b0c-88e5-633d04fe60cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e1f09bd-1e01-460e-be13-9b1749b27926", "tag": "6a458fb5-32cd-48f8-8aa2-9f2629863eb3"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:12:32.584662 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-789ea889-b3c8-4a10-a31c-1b995088e6bc req-3138718b-edb0-4b0c-88e5-633d04fe60cb service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:32.585119 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-789ea889-b3c8-4a10-a31c-1b995088e6bc req-3138718b-edb0-4b0c-88e5-633d04fe60cb service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:32.598061 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-789ea889-b3c8-4a10-a31c-1b995088e6bc req-3138718b-edb0-4b0c-88e5-633d04fe60cb service nova] Creating event network-changed:6a458fb5-32cd-48f8-8aa2-9f2629863eb3 for instance 4e1f09bd-1e01-460e-be13-9b1749b27926 on hv-cinder-84301 May 26 15:12:32.604563 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-789ea889-b3c8-4a10-a31c-1b995088e6bc req-3138718b-edb0-4b0c-88e5-633d04fe60cb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032459 May 26 15:12:32.605610 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 215/397] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:12:54.598161 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-da5f577b-d1be-49f6-80a2-8009ec0bef0a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:54.598768 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-da5f577b-d1be-49f6-80a2-8009ec0bef0a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:54.600783 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=26 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:12:54.601586 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=50 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:12:54.607901 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-da5f577b-d1be-49f6-80a2-8009ec0bef0a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:54.608343 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-da5f577b-d1be-49f6-80a2-8009ec0bef0a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:54.609115 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-da5f577b-d1be-49f6-80a2-8009ec0bef0a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:54.609548 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-da5f577b-d1be-49f6-80a2-8009ec0bef0a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:54.633562 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-da5f577b-d1be-49f6-80a2-8009ec0bef0a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c/ips" status: 200 len: 146 microversion: 2.1 time: 0.039408 May 26 15:12:54.634395 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 183/398] 10.222.0.45 () {58 vars in 1247 bytes} [Thu May 26 15:12:54 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:12:56.717736 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:12:56.718500 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=54 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:12:56.723176 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-cb1947d0-5d18-4ffe-890b-667a99ab592e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4fbad532-0105-44c7-b0c5-843e6003114d"}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:12:56.724377 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-cb1947d0-5d18-4ffe-890b-667a99ab592e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:56.733010 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-cb1947d0-5d18-4ffe-890b-667a99ab592e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:56.733457 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-cb1947d0-5d18-4ffe-890b-667a99ab592e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:56.734271 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-cb1947d0-5d18-4ffe-890b-667a99ab592e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:56.734708 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-cb1947d0-5d18-4ffe-890b-667a99ab592e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:56.898819 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-cc149b6a-95a4-414a-beee-162b9c8ebc2b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:56.899947 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-cc149b6a-95a4-414a-beee-162b9c8ebc2b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:56.908248 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cc149b6a-95a4-414a-beee-162b9c8ebc2b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:56.908747 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cc149b6a-95a4-414a-beee-162b9c8ebc2b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:56.909508 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cc149b6a-95a4-414a-beee-162b9c8ebc2b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:56.909932 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cc149b6a-95a4-414a-beee-162b9c8ebc2b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:56.935240 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-cc149b6a-95a4-414a-beee-162b9c8ebc2b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6/ips" status: 200 len: 152 microversion: 2.20 time: 0.041403 May 26 15:12:56.935820 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 184/399] 10.222.0.45 () {60 vars in 1288 bytes} [Thu May 26 15:12:56 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6/ips => generated 152 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 15:12:57.013752 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-cb1947d0-5d18-4ffe-890b-667a99ab592e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "POST /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296730 May 26 15:12:57.014464 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 216/400] 10.222.0.45 () {60 vars in 1322 bytes} [Thu May 26 15:12:56 2022] POST /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:12:58.897445 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1f53cd0c-392e-4e90-9ad5-2f6420fa1674 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:12:58.897977 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1f53cd0c-392e-4e90-9ad5-2f6420fa1674 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:58.905363 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1f53cd0c-392e-4e90-9ad5-2f6420fa1674 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:58.905803 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1f53cd0c-392e-4e90-9ad5-2f6420fa1674 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:58.906568 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1f53cd0c-392e-4e90-9ad5-2f6420fa1674 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:58.906995 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1f53cd0c-392e-4e90-9ad5-2f6420fa1674 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:58.930608 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.objects.instance [None req-1f53cd0c-392e-4e90-9ad5-2f6420fa1674 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lazy-loading 'flavor' on Instance uuid 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 {{(pid=117798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:12:59.239962 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1f53cd0c-392e-4e90-9ad5-2f6420fa1674 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "POST /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6/action" status: 202 len: 0 microversion: 2.20 time: 0.345892 May 26 15:12:59.239962 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 185/401] 10.222.0.45 () {62 vars in 1318 bytes} [Thu May 26 15:12:58 2022] POST /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 15:12:59.243604 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-38f23c64-5a42-4075-b5ab-552ec3625ea4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:59.244809 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-38f23c64-5a42-4075-b5ab-552ec3625ea4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:59.249482 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c5379059-d1f9-4beb-b79d-12ffa7fbaef3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:59.250180 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c5379059-d1f9-4beb-b79d-12ffa7fbaef3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:59.252862 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-38f23c64-5a42-4075-b5ab-552ec3625ea4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:59.253317 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-38f23c64-5a42-4075-b5ab-552ec3625ea4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:59.254100 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-38f23c64-5a42-4075-b5ab-552ec3625ea4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:59.254538 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-38f23c64-5a42-4075-b5ab-552ec3625ea4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:59.256945 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c5379059-d1f9-4beb-b79d-12ffa7fbaef3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:59.257477 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c5379059-d1f9-4beb-b79d-12ffa7fbaef3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:59.258216 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c5379059-d1f9-4beb-b79d-12ffa7fbaef3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:59.258650 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c5379059-d1f9-4beb-b79d-12ffa7fbaef3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:59.284156 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-38f23c64-5a42-4075-b5ab-552ec3625ea4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df/ips" status: 200 len: 150 microversion: 2.1 time: 0.045529 May 26 15:12:59.284745 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 217/402] 10.222.0.45 () {58 vars in 1247 bytes} [Thu May 26 15:12:59 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:12:59.402913 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c5379059-d1f9-4beb-b79d-12ffa7fbaef3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:59.411847 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c5379059-d1f9-4beb-b79d-12ffa7fbaef3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:59.413370 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c5379059-d1f9-4beb-b79d-12ffa7fbaef3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:59.414544 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c5379059-d1f9-4beb-b79d-12ffa7fbaef3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1723 microversion: 2.20 time: 0.170294 May 26 15:12:59.415115 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 186/403] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:12:59 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:13:00.436807 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-ad8aa908-4af2-42d4-8592-ad8bb7256ccc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:00.437432 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-ad8aa908-4af2-42d4-8592-ad8bb7256ccc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:00.444215 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ad8aa908-4af2-42d4-8592-ad8bb7256ccc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:00.444662 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ad8aa908-4af2-42d4-8592-ad8bb7256ccc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:00.445422 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ad8aa908-4af2-42d4-8592-ad8bb7256ccc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:00.445844 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ad8aa908-4af2-42d4-8592-ad8bb7256ccc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:00.584573 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-ad8aa908-4af2-42d4-8592-ad8bb7256ccc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:00.593888 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-ad8aa908-4af2-42d4-8592-ad8bb7256ccc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:00.595504 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-ad8aa908-4af2-42d4-8592-ad8bb7256ccc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:00.596676 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-ad8aa908-4af2-42d4-8592-ad8bb7256ccc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1723 microversion: 2.20 time: 0.165948 May 26 15:13:00.597243 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 218/404] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:00 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:00.672046 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e5f0dbf1-1912-4452-b517-4654f23129b4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9be0290-06e5-4b28-9b95-02483743f240"}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:13:00.673141 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e5f0dbf1-1912-4452-b517-4654f23129b4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:00.679789 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e5f0dbf1-1912-4452-b517-4654f23129b4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:00.680228 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e5f0dbf1-1912-4452-b517-4654f23129b4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:00.680978 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e5f0dbf1-1912-4452-b517-4654f23129b4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:00.681454 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e5f0dbf1-1912-4452-b517-4654f23129b4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:00.935025 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e5f0dbf1-1912-4452-b517-4654f23129b4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "POST /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266834 May 26 15:13:00.935734 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 187/405] 10.222.0.45 () {60 vars in 1322 bytes} [Thu May 26 15:13:00 2022] POST /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:13:01.616470 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-846b8ac0-4cf5-4938-84b6-08da57e8308c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:01.617089 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-846b8ac0-4cf5-4938-84b6-08da57e8308c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:01.624928 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-846b8ac0-4cf5-4938-84b6-08da57e8308c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:01.625366 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-846b8ac0-4cf5-4938-84b6-08da57e8308c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:01.626130 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-846b8ac0-4cf5-4938-84b6-08da57e8308c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:01.626557 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-846b8ac0-4cf5-4938-84b6-08da57e8308c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:01.767109 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-846b8ac0-4cf5-4938-84b6-08da57e8308c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:01.775489 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-846b8ac0-4cf5-4938-84b6-08da57e8308c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:01.777124 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-846b8ac0-4cf5-4938-84b6-08da57e8308c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:01.778281 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-846b8ac0-4cf5-4938-84b6-08da57e8308c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1723 microversion: 2.20 time: 0.165781 May 26 15:13:01.778831 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 219/406] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:01 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:02.797693 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e59f2c7f-762f-4c1c-8d5a-0484ed21cdaf tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:02.798385 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e59f2c7f-762f-4c1c-8d5a-0484ed21cdaf tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:02.804943 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e59f2c7f-762f-4c1c-8d5a-0484ed21cdaf tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:02.805401 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e59f2c7f-762f-4c1c-8d5a-0484ed21cdaf tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:02.806181 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e59f2c7f-762f-4c1c-8d5a-0484ed21cdaf tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:02.807291 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e59f2c7f-762f-4c1c-8d5a-0484ed21cdaf tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:02.941175 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e59f2c7f-762f-4c1c-8d5a-0484ed21cdaf tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:02.949345 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e59f2c7f-762f-4c1c-8d5a-0484ed21cdaf tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:02.950850 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e59f2c7f-762f-4c1c-8d5a-0484ed21cdaf tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:02.952059 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e59f2c7f-762f-4c1c-8d5a-0484ed21cdaf tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1723 microversion: 2.20 time: 0.159194 May 26 15:13:02.952620 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 188/407] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:02 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:13:03.971932 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-b16b112e-6fea-4e76-ae79-9a6c42d95d18 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:03.972518 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-b16b112e-6fea-4e76-ae79-9a6c42d95d18 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:03.980329 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b16b112e-6fea-4e76-ae79-9a6c42d95d18 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:03.980763 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b16b112e-6fea-4e76-ae79-9a6c42d95d18 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:03.981520 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b16b112e-6fea-4e76-ae79-9a6c42d95d18 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:03.981943 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b16b112e-6fea-4e76-ae79-9a6c42d95d18 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:04.133784 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-b16b112e-6fea-4e76-ae79-9a6c42d95d18 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:04.145703 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-b16b112e-6fea-4e76-ae79-9a6c42d95d18 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:04.147587 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-b16b112e-6fea-4e76-ae79-9a6c42d95d18 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:04.148861 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-b16b112e-6fea-4e76-ae79-9a6c42d95d18 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1723 microversion: 2.20 time: 0.180763 May 26 15:13:04.149405 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 220/408] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:03 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:04.532326 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-493929ca-3515-4e26-a434-98ff2cacb3df tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:13:04.539245 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-493929ca-3515-4e26-a434-98ff2cacb3df tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:04.539704 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-493929ca-3515-4e26-a434-98ff2cacb3df tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:04.601370 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-493929ca-3515-4e26-a434-98ff2cacb3df tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Going to try to stop instance {{(pid=117798) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 26 15:13:04.652612 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-493929ca-3515-4e26-a434-98ff2cacb3df tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "POST /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c/action" status: 202 len: 0 microversion: 2.1 time: 0.124135 May 26 15:13:04.653217 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 189/409] 10.222.0.45 () {60 vars in 1277 bytes} [Thu May 26 15:13:04 2022] POST /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:13:04.663912 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-ec348531-8333-4494-950f-81408092caaa tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:04.664521 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-ec348531-8333-4494-950f-81408092caaa tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:04.673115 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ec348531-8333-4494-950f-81408092caaa tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:04.673461 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ec348531-8333-4494-950f-81408092caaa tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:04.674237 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ec348531-8333-4494-950f-81408092caaa tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:04.674665 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ec348531-8333-4494-950f-81408092caaa tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:04.806907 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-ec348531-8333-4494-950f-81408092caaa tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:04.815344 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-ec348531-8333-4494-950f-81408092caaa tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1723 microversion: 2.1 time: 0.157789 May 26 15:13:04.815912 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 221/410] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:13:04 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:05.169171 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-81fa80a1-d943-43ee-8b1b-0e2d2de98833 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:05.169933 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-81fa80a1-d943-43ee-8b1b-0e2d2de98833 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:05.176163 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-81fa80a1-d943-43ee-8b1b-0e2d2de98833 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:05.176607 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-81fa80a1-d943-43ee-8b1b-0e2d2de98833 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:05.177373 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-81fa80a1-d943-43ee-8b1b-0e2d2de98833 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:05.177805 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-81fa80a1-d943-43ee-8b1b-0e2d2de98833 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:05.314592 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-81fa80a1-d943-43ee-8b1b-0e2d2de98833 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:05.323761 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-81fa80a1-d943-43ee-8b1b-0e2d2de98833 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:05.325290 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-81fa80a1-d943-43ee-8b1b-0e2d2de98833 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:05.326456 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-81fa80a1-d943-43ee-8b1b-0e2d2de98833 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1723 microversion: 2.20 time: 0.162104 May 26 15:13:05.327022 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 190/411] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:05 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:05.833359 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-94992104-326d-49b8-aab7-80c87d09a822 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:05.833970 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-94992104-326d-49b8-aab7-80c87d09a822 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:05.841211 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-94992104-326d-49b8-aab7-80c87d09a822 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:05.841654 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-94992104-326d-49b8-aab7-80c87d09a822 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:05.842428 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-94992104-326d-49b8-aab7-80c87d09a822 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:05.842865 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-94992104-326d-49b8-aab7-80c87d09a822 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:05.992428 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-94992104-326d-49b8-aab7-80c87d09a822 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:06.004019 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-94992104-326d-49b8-aab7-80c87d09a822 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1723 microversion: 2.1 time: 0.174490 May 26 15:13:06.004608 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 222/412] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:13:05 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:06.344288 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-481207fb-c279-4f59-9df6-588022d04340 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:06.344890 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-481207fb-c279-4f59-9df6-588022d04340 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:06.351477 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-481207fb-c279-4f59-9df6-588022d04340 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:06.351924 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-481207fb-c279-4f59-9df6-588022d04340 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:06.352690 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-481207fb-c279-4f59-9df6-588022d04340 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:06.353670 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-481207fb-c279-4f59-9df6-588022d04340 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:06.484623 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-481207fb-c279-4f59-9df6-588022d04340 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:06.492892 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-481207fb-c279-4f59-9df6-588022d04340 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:06.495058 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-481207fb-c279-4f59-9df6-588022d04340 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:06.496245 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-481207fb-c279-4f59-9df6-588022d04340 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1723 microversion: 2.20 time: 0.155872 May 26 15:13:06.496795 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 191/413] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:06 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:07.022061 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-db2db299-b6ee-47b1-8cfd-a18f2e9d2ce6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:07.022670 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-db2db299-b6ee-47b1-8cfd-a18f2e9d2ce6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:07.030946 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-db2db299-b6ee-47b1-8cfd-a18f2e9d2ce6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:07.031431 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-db2db299-b6ee-47b1-8cfd-a18f2e9d2ce6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:07.032212 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-db2db299-b6ee-47b1-8cfd-a18f2e9d2ce6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:07.032650 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-db2db299-b6ee-47b1-8cfd-a18f2e9d2ce6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:07.168020 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-db2db299-b6ee-47b1-8cfd-a18f2e9d2ce6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:07.176325 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-db2db299-b6ee-47b1-8cfd-a18f2e9d2ce6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1723 microversion: 2.1 time: 0.158352 May 26 15:13:07.176903 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 223/414] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:13:07 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:07.514750 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e4ecbf17-49e1-4288-9a47-a97dc8761e08 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:07.515393 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e4ecbf17-49e1-4288-9a47-a97dc8761e08 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:07.522262 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e4ecbf17-49e1-4288-9a47-a97dc8761e08 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:07.522705 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e4ecbf17-49e1-4288-9a47-a97dc8761e08 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:07.523513 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e4ecbf17-49e1-4288-9a47-a97dc8761e08 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:07.523948 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e4ecbf17-49e1-4288-9a47-a97dc8761e08 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:07.659342 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e4ecbf17-49e1-4288-9a47-a97dc8761e08 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:07.668381 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e4ecbf17-49e1-4288-9a47-a97dc8761e08 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:07.669890 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e4ecbf17-49e1-4288-9a47-a97dc8761e08 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:07.671065 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e4ecbf17-49e1-4288-9a47-a97dc8761e08 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1723 microversion: 2.20 time: 0.160333 May 26 15:13:07.671656 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 192/415] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:07 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:08.193870 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-738ad219-c10c-405d-9141-f521fd99b280 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:08.194475 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-738ad219-c10c-405d-9141-f521fd99b280 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:08.201807 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-738ad219-c10c-405d-9141-f521fd99b280 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:08.202249 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-738ad219-c10c-405d-9141-f521fd99b280 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:08.203049 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-738ad219-c10c-405d-9141-f521fd99b280 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:08.203505 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-738ad219-c10c-405d-9141-f521fd99b280 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:08.343436 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-738ad219-c10c-405d-9141-f521fd99b280 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:08.351653 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-738ad219-c10c-405d-9141-f521fd99b280 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1723 microversion: 2.1 time: 0.161694 May 26 15:13:08.352237 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 224/416] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:13:08 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:08.690530 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e21e4f57-2541-4b90-92fa-3fb787584909 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:08.691103 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e21e4f57-2541-4b90-92fa-3fb787584909 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:08.698850 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e21e4f57-2541-4b90-92fa-3fb787584909 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:08.699334 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e21e4f57-2541-4b90-92fa-3fb787584909 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:08.700093 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e21e4f57-2541-4b90-92fa-3fb787584909 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:08.700520 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e21e4f57-2541-4b90-92fa-3fb787584909 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:08.839634 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e21e4f57-2541-4b90-92fa-3fb787584909 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:08.847844 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e21e4f57-2541-4b90-92fa-3fb787584909 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:08.849430 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e21e4f57-2541-4b90-92fa-3fb787584909 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:08.850635 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e21e4f57-2541-4b90-92fa-3fb787584909 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1723 microversion: 2.20 time: 0.164057 May 26 15:13:08.852794 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 193/417] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:08 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:09.371004 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-b16de216-1614-442d-a7a9-f9da8c1a0327 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:09.371581 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-b16de216-1614-442d-a7a9-f9da8c1a0327 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:09.378038 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b16de216-1614-442d-a7a9-f9da8c1a0327 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:09.378502 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b16de216-1614-442d-a7a9-f9da8c1a0327 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:09.379297 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b16de216-1614-442d-a7a9-f9da8c1a0327 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:09.379751 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b16de216-1614-442d-a7a9-f9da8c1a0327 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:09.518820 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-b16de216-1614-442d-a7a9-f9da8c1a0327 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:09.527390 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-b16de216-1614-442d-a7a9-f9da8c1a0327 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1723 microversion: 2.1 time: 0.161405 May 26 15:13:09.528021 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 225/418] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:13:09 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:09.869080 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ba9fe975-da02-4b90-8e8c-d7abc50c05ec tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:09.870076 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ba9fe975-da02-4b90-8e8c-d7abc50c05ec tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:09.877681 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ba9fe975-da02-4b90-8e8c-d7abc50c05ec tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:09.878117 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ba9fe975-da02-4b90-8e8c-d7abc50c05ec tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:09.878911 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ba9fe975-da02-4b90-8e8c-d7abc50c05ec tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:09.879383 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ba9fe975-da02-4b90-8e8c-d7abc50c05ec tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:10.016914 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ba9fe975-da02-4b90-8e8c-d7abc50c05ec tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:10.025947 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ba9fe975-da02-4b90-8e8c-d7abc50c05ec tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:10.027746 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ba9fe975-da02-4b90-8e8c-d7abc50c05ec tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:10.029073 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ba9fe975-da02-4b90-8e8c-d7abc50c05ec tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1723 microversion: 2.20 time: 0.163959 May 26 15:13:10.029640 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 194/419] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:09 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:10.545195 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-f3424b60-c4e2-463c-a4d3-88f95a91287e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:10.545799 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-f3424b60-c4e2-463c-a4d3-88f95a91287e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:10.552368 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f3424b60-c4e2-463c-a4d3-88f95a91287e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:10.552817 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f3424b60-c4e2-463c-a4d3-88f95a91287e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:10.553602 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f3424b60-c4e2-463c-a4d3-88f95a91287e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:10.554009 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f3424b60-c4e2-463c-a4d3-88f95a91287e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:10.689673 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-f3424b60-c4e2-463c-a4d3-88f95a91287e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:10.697720 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-f3424b60-c4e2-463c-a4d3-88f95a91287e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1723 microversion: 2.1 time: 0.156842 May 26 15:13:10.698288 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 226/420] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:13:10 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:11.048252 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-5bacbc54-1f37-42f2-9a82-ea67f9c9fe34 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:11.048900 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-5bacbc54-1f37-42f2-9a82-ea67f9c9fe34 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:11.057624 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5bacbc54-1f37-42f2-9a82-ea67f9c9fe34 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:11.058076 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5bacbc54-1f37-42f2-9a82-ea67f9c9fe34 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:11.058860 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5bacbc54-1f37-42f2-9a82-ea67f9c9fe34 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:11.059341 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5bacbc54-1f37-42f2-9a82-ea67f9c9fe34 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:11.204212 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-5bacbc54-1f37-42f2-9a82-ea67f9c9fe34 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:11.207731 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:13:11.213984 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-5bacbc54-1f37-42f2-9a82-ea67f9c9fe34 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:11.215852 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-5bacbc54-1f37-42f2-9a82-ea67f9c9fe34 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:11.217062 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-5bacbc54-1f37-42f2-9a82-ea67f9c9fe34 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1723 microversion: 2.20 time: 0.173189 May 26 15:13:11.217632 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 195/421] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:11 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:13:11.648276 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-3e3619c5-e25c-4104-82fa-b5bcbc352e12 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Action: 'create', calling method: .version_select at 0x7ffb5d9ff430>, body: {"keypair": {"name": "tempest-keypair-2092088863", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQwHrPInnisbG5eO/CSndSb5WREGc9LGpf6ysYCZ/QcXmV3jlK9IIy1nJIWS8ZdHsYjvGO9dvwn+rhIdydDOld9dYJotMoEoblQ7yMEfrqTwwFsuZUhFA+AX9RCo6pMmA=="}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:13:11.663584 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.quota [None req-3e3619c5-e25c-4104-82fa-b5bcbc352e12 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Getting quotas for project 196700c560cd4d6e9461ec9571facf39. Resources: {'key_pairs'} {{(pid=117799) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:13:11.667677 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.quota [None req-3e3619c5-e25c-4104-82fa-b5bcbc352e12 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Getting quotas for user 1421fb674ae04d6ea9ae342b73ce8115 and project 196700c560cd4d6e9461ec9571facf39. Resources: {'key_pairs'} {{(pid=117799) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:13:11.689622 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-3e3619c5-e25c-4104-82fa-b5bcbc352e12 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045427 May 26 15:13:11.690224 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 227/422] 10.222.0.45 () {60 vars in 1158 bytes} [Thu May 26 15:13:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:13:11.715194 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-2a49d806-fc7c-42be-a4f4-33321e72c3ba tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:11.715806 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-2a49d806-fc7c-42be-a4f4-33321e72c3ba tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:11.723079 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2a49d806-fc7c-42be-a4f4-33321e72c3ba tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:11.723595 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2a49d806-fc7c-42be-a4f4-33321e72c3ba tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:11.724472 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2a49d806-fc7c-42be-a4f4-33321e72c3ba tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:11.724913 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2a49d806-fc7c-42be-a4f4-33321e72c3ba tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:11.883793 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2a49d806-fc7c-42be-a4f4-33321e72c3ba tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:11.893303 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-2a49d806-fc7c-42be-a4f4-33321e72c3ba tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1723 microversion: 2.1 time: 0.182578 May 26 15:13:11.894082 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 196/423] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:13:11 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:12.235717 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-c53b434e-8be6-4200-a7b7-c5349952c6db tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:12.236335 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-c53b434e-8be6-4200-a7b7-c5349952c6db tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:12.242330 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c53b434e-8be6-4200-a7b7-c5349952c6db tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:12.242789 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c53b434e-8be6-4200-a7b7-c5349952c6db tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:12.243618 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c53b434e-8be6-4200-a7b7-c5349952c6db tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:12.244958 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c53b434e-8be6-4200-a7b7-c5349952c6db tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:12.392275 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-c53b434e-8be6-4200-a7b7-c5349952c6db tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:12.402982 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-c53b434e-8be6-4200-a7b7-c5349952c6db tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:12.404552 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-c53b434e-8be6-4200-a7b7-c5349952c6db tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:12.406528 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-c53b434e-8be6-4200-a7b7-c5349952c6db tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1723 microversion: 2.20 time: 0.174524 May 26 15:13:12.419114 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 228/424] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:12 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:12.911037 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-faeeb8e7-e23e-4a51-9ceb-313878f64696 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:12.911871 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-faeeb8e7-e23e-4a51-9ceb-313878f64696 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:12.919317 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-faeeb8e7-e23e-4a51-9ceb-313878f64696 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:12.919847 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-faeeb8e7-e23e-4a51-9ceb-313878f64696 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:12.920688 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-faeeb8e7-e23e-4a51-9ceb-313878f64696 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:12.921193 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-faeeb8e7-e23e-4a51-9ceb-313878f64696 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:13.071108 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-faeeb8e7-e23e-4a51-9ceb-313878f64696 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:13.079832 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-faeeb8e7-e23e-4a51-9ceb-313878f64696 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1723 microversion: 2.1 time: 0.172614 May 26 15:13:13.080410 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 197/425] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:13:12 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:13.135563 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-6be12096-fc13-4d25-bdc1-0592db9d4c62 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-223816711", "imageRef": "5b5a68b4-38e3-4f05-b97f-4339d6752e34", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aeb58b02-96d6-4f2b-8272-441acfd1f591"}], "security_groups": [{"name": "tempest-securitygroup--587471841"}], "key_name": "tempest-keypair-2092088863", "user_data": "}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:13:13.240202 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.network.neutron [None req-6be12096-fc13-4d25-bdc1-0592db9d4c62 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] validate_networks() for [('aeb58b02-96d6-4f2b-8272-441acfd1f591', None, None, None, None, None)] {{(pid=117799) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:13:13.427881 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-2fdcdf7f-dbbd-496e-9bf3-51b82ff855e8 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:13.428493 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-2fdcdf7f-dbbd-496e-9bf3-51b82ff855e8 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:13.434579 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2fdcdf7f-dbbd-496e-9bf3-51b82ff855e8 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:13.435038 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2fdcdf7f-dbbd-496e-9bf3-51b82ff855e8 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:13.435848 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2fdcdf7f-dbbd-496e-9bf3-51b82ff855e8 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:13.436293 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2fdcdf7f-dbbd-496e-9bf3-51b82ff855e8 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:13.655890 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2fdcdf7f-dbbd-496e-9bf3-51b82ff855e8 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:13.664065 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2fdcdf7f-dbbd-496e-9bf3-51b82ff855e8 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:13.665708 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2fdcdf7f-dbbd-496e-9bf3-51b82ff855e8 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:13.667567 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-2fdcdf7f-dbbd-496e-9bf3-51b82ff855e8 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1723 microversion: 2.20 time: 0.244019 May 26 15:13:13.668132 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 198/426] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:13 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:13:13.694544 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-6be12096-fc13-4d25-bdc1-0592db9d4c62 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Flavor limits 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:13:13.694989 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-6be12096-fc13-4d25-bdc1-0592db9d4c62 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Image limits 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:13:13.695533 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-6be12096-fc13-4d25-bdc1-0592db9d4c62 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Flavor pref 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:13:13.695952 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-6be12096-fc13-4d25-bdc1-0592db9d4c62 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Image pref 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:13:13.696356 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-6be12096-fc13-4d25-bdc1-0592db9d4c62 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:13:13.706685 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6be12096-fc13-4d25-bdc1-0592db9d4c62 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:13.707151 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6be12096-fc13-4d25-bdc1-0592db9d4c62 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:13.707935 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6be12096-fc13-4d25-bdc1-0592db9d4c62 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:13.708358 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6be12096-fc13-4d25-bdc1-0592db9d4c62 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:13.726098 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.quota [None req-6be12096-fc13-4d25-bdc1-0592db9d4c62 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Getting quotas for project 196700c560cd4d6e9461ec9571facf39. Resources: {'cores', 'ram', 'instances'} {{(pid=117799) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:13:13.730679 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.quota [None req-6be12096-fc13-4d25-bdc1-0592db9d4c62 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Getting quotas for user 1421fb674ae04d6ea9ae342b73ce8115 and project 196700c560cd4d6e9461ec9571facf39. Resources: {'cores', 'ram', 'instances'} {{(pid=117799) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:13:13.746457 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-6be12096-fc13-4d25-bdc1-0592db9d4c62 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Going to run 1 instances... {{(pid=117799) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:13:13.748809 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-6be12096-fc13-4d25-bdc1-0592db9d4c62 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 966278e6-017a-4267-a3b1-98edbcde5e16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5b5a68b4-38e3-4f05-b97f-4339d6752e34',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117799) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:13:13.797596 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-6be12096-fc13-4d25-bdc1-0592db9d4c62 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.666293 May 26 15:13:13.798342 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 229/427] 10.222.0.45 () {60 vars in 1146 bytes} [Thu May 26 15:13:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 15:13:13.808265 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b8332ac0-8890-42ea-81c7-3344274252ca tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:13.808873 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b8332ac0-8890-42ea-81c7-3344274252ca tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 966278e6-017a-4267-a3b1-98edbcde5e16] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:13.864424 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b8332ac0-8890-42ea-81c7-3344274252ca tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:13.872930 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b8332ac0-8890-42ea-81c7-3344274252ca tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16" status: 200 len: 1241 microversion: 2.1 time: 0.068547 May 26 15:13:13.873513 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 199/428] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:13:13 2022] GET /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:14.108110 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-3e587d77-4097-40ea-b00e-9f2bb12f9039 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:14.108110 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-3e587d77-4097-40ea-b00e-9f2bb12f9039 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:14.114020 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-3e587d77-4097-40ea-b00e-9f2bb12f9039 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:14.114467 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-3e587d77-4097-40ea-b00e-9f2bb12f9039 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:14.115349 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-3e587d77-4097-40ea-b00e-9f2bb12f9039 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:14.115676 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-3e587d77-4097-40ea-b00e-9f2bb12f9039 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:14.264200 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-3e587d77-4097-40ea-b00e-9f2bb12f9039 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:14.272834 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-3e587d77-4097-40ea-b00e-9f2bb12f9039 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1723 microversion: 2.1 time: 0.175129 May 26 15:13:14.273748 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 230/429] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:13:14 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:14.686593 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d68fa55e-d067-430d-9034-f26eed4590c5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:14.687230 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-d68fa55e-d067-430d-9034-f26eed4590c5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:14.694041 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d68fa55e-d067-430d-9034-f26eed4590c5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:14.694482 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d68fa55e-d067-430d-9034-f26eed4590c5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:14.695404 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d68fa55e-d067-430d-9034-f26eed4590c5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:14.695861 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d68fa55e-d067-430d-9034-f26eed4590c5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:14.830483 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d68fa55e-d067-430d-9034-f26eed4590c5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:14.839953 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d68fa55e-d067-430d-9034-f26eed4590c5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:14.841470 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d68fa55e-d067-430d-9034-f26eed4590c5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:14.842647 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-d68fa55e-d067-430d-9034-f26eed4590c5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1723 microversion: 2.20 time: 0.160038 May 26 15:13:14.843262 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 200/430] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:14 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:14.890317 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-1cd93c8f-a980-4690-ac7e-2cf2dc787de5 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:14.890924 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-1cd93c8f-a980-4690-ac7e-2cf2dc787de5 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 966278e6-017a-4267-a3b1-98edbcde5e16] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:14.897533 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1cd93c8f-a980-4690-ac7e-2cf2dc787de5 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:14.897981 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1cd93c8f-a980-4690-ac7e-2cf2dc787de5 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:14.898753 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1cd93c8f-a980-4690-ac7e-2cf2dc787de5 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:14.899224 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1cd93c8f-a980-4690-ac7e-2cf2dc787de5 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:14.966297 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-1cd93c8f-a980-4690-ac7e-2cf2dc787de5 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:14.973410 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-1cd93c8f-a980-4690-ac7e-2cf2dc787de5 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16" status: 200 len: 1293 microversion: 2.1 time: 0.087008 May 26 15:13:14.973983 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 231/431] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:13:14 2022] GET /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16 => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:15.290882 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a299770d-a9ff-48ac-ad09-898fd5c672bb tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:15.291527 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a299770d-a9ff-48ac-ad09-898fd5c672bb tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:15.297696 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a299770d-a9ff-48ac-ad09-898fd5c672bb tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:15.298121 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a299770d-a9ff-48ac-ad09-898fd5c672bb tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:15.298887 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a299770d-a9ff-48ac-ad09-898fd5c672bb tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:15.299345 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a299770d-a9ff-48ac-ad09-898fd5c672bb tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:15.440232 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a299770d-a9ff-48ac-ad09-898fd5c672bb tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:15.449490 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a299770d-a9ff-48ac-ad09-898fd5c672bb tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1723 microversion: 2.1 time: 0.162672 May 26 15:13:15.450070 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 201/432] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:13:15 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:15.862019 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-405ef548-6bed-4c8a-9528-042ec9b6f1c1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:15.862614 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-405ef548-6bed-4c8a-9528-042ec9b6f1c1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:15.870335 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-405ef548-6bed-4c8a-9528-042ec9b6f1c1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:15.870862 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-405ef548-6bed-4c8a-9528-042ec9b6f1c1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:15.871895 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-405ef548-6bed-4c8a-9528-042ec9b6f1c1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:15.872333 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-405ef548-6bed-4c8a-9528-042ec9b6f1c1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:15.997661 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-64f7c704-ed20-45af-b23d-2c943e5af6ec tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:15.998763 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-64f7c704-ed20-45af-b23d-2c943e5af6ec tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 966278e6-017a-4267-a3b1-98edbcde5e16] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:16.025312 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-64f7c704-ed20-45af-b23d-2c943e5af6ec tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:16.026360 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-64f7c704-ed20-45af-b23d-2c943e5af6ec tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:16.027370 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-64f7c704-ed20-45af-b23d-2c943e5af6ec tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:16.028114 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-64f7c704-ed20-45af-b23d-2c943e5af6ec tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:16.040854 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-405ef548-6bed-4c8a-9528-042ec9b6f1c1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:16.050533 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-405ef548-6bed-4c8a-9528-042ec9b6f1c1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:16.052097 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-405ef548-6bed-4c8a-9528-042ec9b6f1c1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:16.053289 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-405ef548-6bed-4c8a-9528-042ec9b6f1c1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1723 microversion: 2.20 time: 0.195288 May 26 15:13:16.053851 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 232/433] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:15 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:16.097613 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-64f7c704-ed20-45af-b23d-2c943e5af6ec tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:16.108123 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-64f7c704-ed20-45af-b23d-2c943e5af6ec tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16" status: 200 len: 1299 microversion: 2.1 time: 0.118471 May 26 15:13:16.108927 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 202/434] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:13:15 2022] GET /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16 => generated 1299 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:16.468878 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-613ef62e-ad78-4835-bc65-7c2b05807c46 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:16.468878 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-613ef62e-ad78-4835-bc65-7c2b05807c46 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:16.475411 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-613ef62e-ad78-4835-bc65-7c2b05807c46 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:16.475998 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-613ef62e-ad78-4835-bc65-7c2b05807c46 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:16.477116 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-613ef62e-ad78-4835-bc65-7c2b05807c46 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:16.477779 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-613ef62e-ad78-4835-bc65-7c2b05807c46 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:16.483858 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:13:16.645249 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-613ef62e-ad78-4835-bc65-7c2b05807c46 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:16.655201 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-613ef62e-ad78-4835-bc65-7c2b05807c46 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1723 microversion: 2.1 time: 0.193133 May 26 15:13:16.655782 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 233/435] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:13:16 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:17.077330 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ed55f4e1-9c91-4fd1-8775-99fe219e560b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:17.078058 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ed55f4e1-9c91-4fd1-8775-99fe219e560b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:17.085696 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ed55f4e1-9c91-4fd1-8775-99fe219e560b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:17.086368 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ed55f4e1-9c91-4fd1-8775-99fe219e560b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:17.087287 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ed55f4e1-9c91-4fd1-8775-99fe219e560b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:17.087890 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ed55f4e1-9c91-4fd1-8775-99fe219e560b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:17.126880 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-bf821ade-ad9a-4d23-9919-2f34afb92908 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:17.127577 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-bf821ade-ad9a-4d23-9919-2f34afb92908 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 966278e6-017a-4267-a3b1-98edbcde5e16] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:17.135057 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-bf821ade-ad9a-4d23-9919-2f34afb92908 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:17.135787 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-bf821ade-ad9a-4d23-9919-2f34afb92908 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:17.136333 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-bf821ade-ad9a-4d23-9919-2f34afb92908 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:17.136940 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-bf821ade-ad9a-4d23-9919-2f34afb92908 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:17.309668 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ed55f4e1-9c91-4fd1-8775-99fe219e560b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:17.318216 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ed55f4e1-9c91-4fd1-8775-99fe219e560b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:17.319825 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ed55f4e1-9c91-4fd1-8775-99fe219e560b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:17.321237 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ed55f4e1-9c91-4fd1-8775-99fe219e560b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1744 microversion: 2.20 time: 0.247953 May 26 15:13:17.332422 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 203/436] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:17 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1744 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:17.338756 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-4571e55f-729c-47a4-903e-dc2c0afe6c35 req-2ecae336-ba68-48b3-9267-f721aeb3678c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "966278e6-017a-4267-a3b1-98edbcde5e16", "tag": "dea2970b-0e07-4876-9293-c6e42ddeeac1"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:13:17.350648 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-4571e55f-729c-47a4-903e-dc2c0afe6c35 req-2ecae336-ba68-48b3-9267-f721aeb3678c service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:17.351305 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-4571e55f-729c-47a4-903e-dc2c0afe6c35 req-2ecae336-ba68-48b3-9267-f721aeb3678c service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:17.365881 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-4571e55f-729c-47a4-903e-dc2c0afe6c35 req-2ecae336-ba68-48b3-9267-f721aeb3678c service nova] Creating event network-changed:dea2970b-0e07-4876-9293-c6e42ddeeac1 for instance 966278e6-017a-4267-a3b1-98edbcde5e16 on hv-cinder-84301 May 26 15:13:17.373005 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-bf821ade-ad9a-4d23-9919-2f34afb92908 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:17.374223 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-4571e55f-729c-47a4-903e-dc2c0afe6c35 req-2ecae336-ba68-48b3-9267-f721aeb3678c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039966 May 26 15:13:17.376114 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 204/437] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:13:17.381151 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-bf821ade-ad9a-4d23-9919-2f34afb92908 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16" status: 200 len: 1366 microversion: 2.1 time: 0.258071 May 26 15:13:17.382287 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 234/438] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:13:17 2022] GET /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16 => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:17.673460 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1e7e4494-26a8-466d-97b8-7b07e1589dd6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:17.674158 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1e7e4494-26a8-466d-97b8-7b07e1589dd6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:17.680813 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1e7e4494-26a8-466d-97b8-7b07e1589dd6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:17.681865 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1e7e4494-26a8-466d-97b8-7b07e1589dd6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:17.682805 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1e7e4494-26a8-466d-97b8-7b07e1589dd6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:17.683272 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1e7e4494-26a8-466d-97b8-7b07e1589dd6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:17.824522 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1e7e4494-26a8-466d-97b8-7b07e1589dd6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:17.832933 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1e7e4494-26a8-466d-97b8-7b07e1589dd6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1723 microversion: 2.1 time: 0.163705 May 26 15:13:17.833686 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 205/439] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:13:17 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:18.341310 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-fe98f33b-4f1e-4b7b-a9f5-c1155f9d7c19 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:18.341889 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-fe98f33b-4f1e-4b7b-a9f5-c1155f9d7c19 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:18.348416 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fe98f33b-4f1e-4b7b-a9f5-c1155f9d7c19 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:18.348859 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fe98f33b-4f1e-4b7b-a9f5-c1155f9d7c19 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:18.349617 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fe98f33b-4f1e-4b7b-a9f5-c1155f9d7c19 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:18.350049 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fe98f33b-4f1e-4b7b-a9f5-c1155f9d7c19 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:18.399435 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-64addcd3-6adc-4ca6-81eb-7739eb0419d3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:18.400977 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-64addcd3-6adc-4ca6-81eb-7739eb0419d3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 966278e6-017a-4267-a3b1-98edbcde5e16] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:18.407945 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-64addcd3-6adc-4ca6-81eb-7739eb0419d3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:18.408527 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-64addcd3-6adc-4ca6-81eb-7739eb0419d3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:18.409457 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-64addcd3-6adc-4ca6-81eb-7739eb0419d3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:18.409993 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-64addcd3-6adc-4ca6-81eb-7739eb0419d3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:18.533985 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-fe98f33b-4f1e-4b7b-a9f5-c1155f9d7c19 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:18.543284 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-fe98f33b-4f1e-4b7b-a9f5-c1155f9d7c19 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:18.544784 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-fe98f33b-4f1e-4b7b-a9f5-c1155f9d7c19 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:18.546004 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-fe98f33b-4f1e-4b7b-a9f5-c1155f9d7c19 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1744 microversion: 2.20 time: 0.208921 May 26 15:13:18.546570 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 235/440] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:18 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1744 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:18.579917 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-64addcd3-6adc-4ca6-81eb-7739eb0419d3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:18.588604 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-64addcd3-6adc-4ca6-81eb-7739eb0419d3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16" status: 200 len: 1366 microversion: 2.1 time: 0.192662 May 26 15:13:18.589196 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 206/441] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:13:18 2022] GET /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:13:18.849971 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-4d15abf0-fcef-4364-b8f7-f464d0e397af tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:18.850569 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-4d15abf0-fcef-4364-b8f7-f464d0e397af tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:18.857610 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4d15abf0-fcef-4364-b8f7-f464d0e397af tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:18.858083 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4d15abf0-fcef-4364-b8f7-f464d0e397af tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:18.858846 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4d15abf0-fcef-4364-b8f7-f464d0e397af tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:18.859306 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4d15abf0-fcef-4364-b8f7-f464d0e397af tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:18.991160 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-4d15abf0-fcef-4364-b8f7-f464d0e397af tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:18.999543 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-4d15abf0-fcef-4364-b8f7-f464d0e397af tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1723 microversion: 2.1 time: 0.153362 May 26 15:13:19.000123 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 236/442] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:13:18 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:19.565227 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-254fddf4-2551-4af4-9b07-b225e9334964 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:19.566090 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-254fddf4-2551-4af4-9b07-b225e9334964 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:19.573848 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-254fddf4-2551-4af4-9b07-b225e9334964 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:19.574288 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-254fddf4-2551-4af4-9b07-b225e9334964 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:19.575055 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-254fddf4-2551-4af4-9b07-b225e9334964 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:19.575507 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-254fddf4-2551-4af4-9b07-b225e9334964 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:19.605613 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-1d8aa693-f14a-4907-a43c-eef1c113f609 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:19.606315 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-1d8aa693-f14a-4907-a43c-eef1c113f609 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 966278e6-017a-4267-a3b1-98edbcde5e16] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:19.613067 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1d8aa693-f14a-4907-a43c-eef1c113f609 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:19.613508 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1d8aa693-f14a-4907-a43c-eef1c113f609 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:19.614282 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1d8aa693-f14a-4907-a43c-eef1c113f609 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:19.614832 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1d8aa693-f14a-4907-a43c-eef1c113f609 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:19.773196 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-254fddf4-2551-4af4-9b07-b225e9334964 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:19.783115 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-254fddf4-2551-4af4-9b07-b225e9334964 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:19.784946 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-254fddf4-2551-4af4-9b07-b225e9334964 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:19.786224 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-254fddf4-2551-4af4-9b07-b225e9334964 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1744 microversion: 2.20 time: 0.224975 May 26 15:13:19.786891 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 207/443] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:19 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1744 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:19.805265 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-1d8aa693-f14a-4907-a43c-eef1c113f609 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:19.815442 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-1d8aa693-f14a-4907-a43c-eef1c113f609 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16" status: 200 len: 1366 microversion: 2.1 time: 0.212666 May 26 15:13:19.815442 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 237/444] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:13:19 2022] GET /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:13:19.921950 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-4f0cbf50-01c6-48e8-ab28-6775d895f3a8 req-25d4c2a3-b044-46a1-8bf2-0123cc76dcd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6", "name": "network-vif-plugged", "status": "completed", "tag": "6342ec5c-6f4f-42ae-aaeb-2f79c05fef02"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:13:19.930161 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-4f0cbf50-01c6-48e8-ab28-6775d895f3a8 req-25d4c2a3-b044-46a1-8bf2-0123cc76dcd4 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:19.930611 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-4f0cbf50-01c6-48e8-ab28-6775d895f3a8 req-25d4c2a3-b044-46a1-8bf2-0123cc76dcd4 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:19.944227 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-4f0cbf50-01c6-48e8-ab28-6775d895f3a8 req-25d4c2a3-b044-46a1-8bf2-0123cc76dcd4 service nova] Creating event network-vif-plugged:6342ec5c-6f4f-42ae-aaeb-2f79c05fef02 for instance 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 on hv-cinder-84301 May 26 15:13:19.949368 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-4f0cbf50-01c6-48e8-ab28-6775d895f3a8 req-25d4c2a3-b044-46a1-8bf2-0123cc76dcd4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031131 May 26 15:13:19.949987 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 208/445] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:13:20.016792 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-83f1cf16-b032-4810-b38d-90bab56077a8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:20.017396 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-83f1cf16-b032-4810-b38d-90bab56077a8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:20.023804 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-83f1cf16-b032-4810-b38d-90bab56077a8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:20.024247 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-83f1cf16-b032-4810-b38d-90bab56077a8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:20.025233 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-83f1cf16-b032-4810-b38d-90bab56077a8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:20.025744 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-83f1cf16-b032-4810-b38d-90bab56077a8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:20.168281 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-83f1cf16-b032-4810-b38d-90bab56077a8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:20.177296 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-83f1cf16-b032-4810-b38d-90bab56077a8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1723 microversion: 2.1 time: 0.164315 May 26 15:13:20.177881 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 238/446] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:13:20 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:20.806991 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e914bba6-ac9f-4d74-9f3d-67399af1c32a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:20.807982 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e914bba6-ac9f-4d74-9f3d-67399af1c32a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:20.815305 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e914bba6-ac9f-4d74-9f3d-67399af1c32a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:20.815749 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e914bba6-ac9f-4d74-9f3d-67399af1c32a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:20.816525 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e914bba6-ac9f-4d74-9f3d-67399af1c32a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:20.816952 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e914bba6-ac9f-4d74-9f3d-67399af1c32a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:20.832559 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-4c100a18-4b37-486e-ab32-e7cbf9866908 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:20.833746 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-4c100a18-4b37-486e-ab32-e7cbf9866908 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 966278e6-017a-4267-a3b1-98edbcde5e16] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:20.840390 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4c100a18-4b37-486e-ab32-e7cbf9866908 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:20.840971 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4c100a18-4b37-486e-ab32-e7cbf9866908 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:20.841951 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4c100a18-4b37-486e-ab32-e7cbf9866908 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:20.842488 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4c100a18-4b37-486e-ab32-e7cbf9866908 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:21.014527 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e914bba6-ac9f-4d74-9f3d-67399af1c32a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:21.023144 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e914bba6-ac9f-4d74-9f3d-67399af1c32a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:21.024738 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e914bba6-ac9f-4d74-9f3d-67399af1c32a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:21.026057 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e914bba6-ac9f-4d74-9f3d-67399af1c32a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1744 microversion: 2.20 time: 0.223906 May 26 15:13:21.026865 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 209/447] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:20 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1744 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:21.045839 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-4c100a18-4b37-486e-ab32-e7cbf9866908 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:21.056394 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-4c100a18-4b37-486e-ab32-e7cbf9866908 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16" status: 200 len: 1366 microversion: 2.1 time: 0.227771 May 26 15:13:21.057075 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 239/448] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:13:20 2022] GET /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16 => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:13:21.198566 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d09af481-cf60-4de8-a0ae-97acb69a65e9 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:21.199248 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-d09af481-cf60-4de8-a0ae-97acb69a65e9 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:21.205933 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d09af481-cf60-4de8-a0ae-97acb69a65e9 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:21.206384 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d09af481-cf60-4de8-a0ae-97acb69a65e9 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:21.207181 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d09af481-cf60-4de8-a0ae-97acb69a65e9 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:21.207620 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d09af481-cf60-4de8-a0ae-97acb69a65e9 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:21.339508 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d09af481-cf60-4de8-a0ae-97acb69a65e9 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:21.347594 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-d09af481-cf60-4de8-a0ae-97acb69a65e9 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1723 microversion: 2.1 time: 0.155568 May 26 15:13:21.348172 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 210/449] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:13:21 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:22.048947 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-732ade49-b1df-4c6f-867c-7b1dc4100c9d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:22.049564 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-732ade49-b1df-4c6f-867c-7b1dc4100c9d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:22.056501 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-732ade49-b1df-4c6f-867c-7b1dc4100c9d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:22.056943 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-732ade49-b1df-4c6f-867c-7b1dc4100c9d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:22.058425 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-732ade49-b1df-4c6f-867c-7b1dc4100c9d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:22.058860 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-732ade49-b1df-4c6f-867c-7b1dc4100c9d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:22.075801 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1e617e30-ca00-49e9-aa4e-4ccf00cc9846 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:22.076450 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1e617e30-ca00-49e9-aa4e-4ccf00cc9846 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 966278e6-017a-4267-a3b1-98edbcde5e16] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:22.083835 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1e617e30-ca00-49e9-aa4e-4ccf00cc9846 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:22.084279 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1e617e30-ca00-49e9-aa4e-4ccf00cc9846 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:22.085049 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1e617e30-ca00-49e9-aa4e-4ccf00cc9846 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:22.085478 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1e617e30-ca00-49e9-aa4e-4ccf00cc9846 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:22.271240 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-732ade49-b1df-4c6f-867c-7b1dc4100c9d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:22.278891 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1e617e30-ca00-49e9-aa4e-4ccf00cc9846 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:22.288599 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1e617e30-ca00-49e9-aa4e-4ccf00cc9846 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16" status: 200 len: 1366 microversion: 2.1 time: 0.215826 May 26 15:13:22.288599 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 211/450] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:13:22 2022] GET /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:22.291796 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-732ade49-b1df-4c6f-867c-7b1dc4100c9d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:22.293303 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-732ade49-b1df-4c6f-867c-7b1dc4100c9d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:22.294698 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-732ade49-b1df-4c6f-867c-7b1dc4100c9d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1744 microversion: 2.20 time: 0.249672 May 26 15:13:22.295337 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 240/451] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:22 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1744 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:22.372290 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a7e9c89a-6c39-4aba-a9fc-24d5543e82c7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:22.372894 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a7e9c89a-6c39-4aba-a9fc-24d5543e82c7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:22.380249 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a7e9c89a-6c39-4aba-a9fc-24d5543e82c7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:22.380958 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a7e9c89a-6c39-4aba-a9fc-24d5543e82c7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:22.381500 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a7e9c89a-6c39-4aba-a9fc-24d5543e82c7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:22.381936 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a7e9c89a-6c39-4aba-a9fc-24d5543e82c7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:22.514655 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a7e9c89a-6c39-4aba-a9fc-24d5543e82c7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:22.522901 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a7e9c89a-6c39-4aba-a9fc-24d5543e82c7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1700 microversion: 2.1 time: 0.161320 May 26 15:13:22.523501 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 212/452] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:13:22 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1700 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:22.539861 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-0eb46114-85d9-4993-80d5-928109eaca6a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:13:22.546193 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0eb46114-85d9-4993-80d5-928109eaca6a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:22.546634 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0eb46114-85d9-4993-80d5-928109eaca6a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:22.609309 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-0eb46114-85d9-4993-80d5-928109eaca6a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Going to try to start instance {{(pid=117799) start /opt/stack/nova/nova/compute/api.py:2730}} May 26 15:13:22.652016 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-0eb46114-85d9-4993-80d5-928109eaca6a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "POST /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c/action" status: 202 len: 0 microversion: 2.1 time: 0.115783 May 26 15:13:22.652623 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 241/453] 10.222.0.45 () {60 vars in 1277 bytes} [Thu May 26 15:13:22 2022] POST /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:13:22.662163 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-211dfa13-2809-492e-a58c-e2732be89ad6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:22.662766 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-211dfa13-2809-492e-a58c-e2732be89ad6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:22.670327 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-211dfa13-2809-492e-a58c-e2732be89ad6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:22.670765 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-211dfa13-2809-492e-a58c-e2732be89ad6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:22.671548 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-211dfa13-2809-492e-a58c-e2732be89ad6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:22.671995 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-211dfa13-2809-492e-a58c-e2732be89ad6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:22.819751 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-211dfa13-2809-492e-a58c-e2732be89ad6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:22.832928 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-211dfa13-2809-492e-a58c-e2732be89ad6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1709 microversion: 2.1 time: 0.175478 May 26 15:13:22.834036 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 213/454] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:13:22 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1709 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:23.306609 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-a1e2b52e-9dde-4cb9-a901-a0293b9a9a2f tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:23.307612 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-a1e2b52e-9dde-4cb9-a901-a0293b9a9a2f tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 966278e6-017a-4267-a3b1-98edbcde5e16] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:23.313182 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-2436f505-c85b-4a86-bb2e-95fe561b6be1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:23.314041 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-2436f505-c85b-4a86-bb2e-95fe561b6be1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:23.314622 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a1e2b52e-9dde-4cb9-a901-a0293b9a9a2f tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:23.315248 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a1e2b52e-9dde-4cb9-a901-a0293b9a9a2f tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:23.316297 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a1e2b52e-9dde-4cb9-a901-a0293b9a9a2f tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:23.316946 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a1e2b52e-9dde-4cb9-a901-a0293b9a9a2f tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:23.320197 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2436f505-c85b-4a86-bb2e-95fe561b6be1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:23.320649 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2436f505-c85b-4a86-bb2e-95fe561b6be1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:23.322058 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2436f505-c85b-4a86-bb2e-95fe561b6be1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:23.322497 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2436f505-c85b-4a86-bb2e-95fe561b6be1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:23.521337 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-a1e2b52e-9dde-4cb9-a901-a0293b9a9a2f tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:23.525061 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2436f505-c85b-4a86-bb2e-95fe561b6be1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:23.528417 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=100 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:13:23.529255 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-a1e2b52e-9dde-4cb9-a901-a0293b9a9a2f tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16" status: 200 len: 1366 microversion: 2.1 time: 0.227451 May 26 15:13:23.530086 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 242/455] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:13:23 2022] GET /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:23.534595 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2436f505-c85b-4a86-bb2e-95fe561b6be1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:23.536141 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2436f505-c85b-4a86-bb2e-95fe561b6be1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:23.537374 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-2436f505-c85b-4a86-bb2e-95fe561b6be1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1744 microversion: 2.20 time: 0.228063 May 26 15:13:23.537877 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 214/456] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:23 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1744 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:13:23.850925 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-e510eaae-a3eb-447b-80c0-cc0ed4b8d39c tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:23.851571 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-e510eaae-a3eb-447b-80c0-cc0ed4b8d39c tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:23.854241 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell0:SELECT=2 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:13:23.854900 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell0:SELECT=10 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:13:23.861521 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e510eaae-a3eb-447b-80c0-cc0ed4b8d39c tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:23.861973 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e510eaae-a3eb-447b-80c0-cc0ed4b8d39c tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:23.862749 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e510eaae-a3eb-447b-80c0-cc0ed4b8d39c tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:23.863230 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e510eaae-a3eb-447b-80c0-cc0ed4b8d39c tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:23.999293 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-e510eaae-a3eb-447b-80c0-cc0ed4b8d39c tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:24.008138 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-e510eaae-a3eb-447b-80c0-cc0ed4b8d39c tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1709 microversion: 2.1 time: 0.161051 May 26 15:13:24.008752 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 243/457] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:13:23 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1709 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:24.356357 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-5a3fcbfc-7fab-44bb-88c8-823734088de8 req-287689b4-746d-4449-be57-aafd7599e06e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "966278e6-017a-4267-a3b1-98edbcde5e16", "name": "network-vif-plugged", "status": "completed", "tag": "dea2970b-0e07-4876-9293-c6e42ddeeac1"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:13:24.359887 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=2 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:13:24.367269 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-5a3fcbfc-7fab-44bb-88c8-823734088de8 req-287689b4-746d-4449-be57-aafd7599e06e service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:24.367841 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-5a3fcbfc-7fab-44bb-88c8-823734088de8 req-287689b4-746d-4449-be57-aafd7599e06e service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:24.380303 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-5a3fcbfc-7fab-44bb-88c8-823734088de8 req-287689b4-746d-4449-be57-aafd7599e06e service nova] Creating event network-vif-plugged:dea2970b-0e07-4876-9293-c6e42ddeeac1 for instance 966278e6-017a-4267-a3b1-98edbcde5e16 on hv-cinder-84301 May 26 15:13:24.385965 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-5a3fcbfc-7fab-44bb-88c8-823734088de8 req-287689b4-746d-4449-be57-aafd7599e06e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033320 May 26 15:13:24.386577 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 215/458] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:13:24.546161 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-66ef784f-3069-4dde-b295-40f51967bafd tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:24.546764 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-66ef784f-3069-4dde-b295-40f51967bafd tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 966278e6-017a-4267-a3b1-98edbcde5e16] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:24.553545 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-66ef784f-3069-4dde-b295-40f51967bafd tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:24.554004 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-66ef784f-3069-4dde-b295-40f51967bafd tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:24.554790 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-66ef784f-3069-4dde-b295-40f51967bafd tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:24.555263 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-66ef784f-3069-4dde-b295-40f51967bafd tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:24.558566 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-7951c10d-0b31-4008-b0c2-7d6b76678d85 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:24.559324 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-7951c10d-0b31-4008-b0c2-7d6b76678d85 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:24.565691 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7951c10d-0b31-4008-b0c2-7d6b76678d85 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:24.566065 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7951c10d-0b31-4008-b0c2-7d6b76678d85 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:24.566876 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7951c10d-0b31-4008-b0c2-7d6b76678d85 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:24.567335 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7951c10d-0b31-4008-b0c2-7d6b76678d85 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:24.780537 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7951c10d-0b31-4008-b0c2-7d6b76678d85 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:24.783430 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-66ef784f-3069-4dde-b295-40f51967bafd tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:24.790023 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7951c10d-0b31-4008-b0c2-7d6b76678d85 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:24.792533 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7951c10d-0b31-4008-b0c2-7d6b76678d85 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:24.792838 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-66ef784f-3069-4dde-b295-40f51967bafd tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16" status: 200 len: 1366 microversion: 2.1 time: 0.250463 May 26 15:13:24.793648 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 244/459] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:13:24 2022] GET /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16 => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:24.799382 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-7951c10d-0b31-4008-b0c2-7d6b76678d85 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1744 microversion: 2.20 time: 0.240063 May 26 15:13:24.799382 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 216/460] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:24 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1744 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:13:25.028169 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-40ddfa48-23ea-484c-acec-9e93572f2107 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:25.028813 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-40ddfa48-23ea-484c-acec-9e93572f2107 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:25.030817 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=71 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:13:25.036176 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-40ddfa48-23ea-484c-acec-9e93572f2107 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:25.036619 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-40ddfa48-23ea-484c-acec-9e93572f2107 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:25.037401 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-40ddfa48-23ea-484c-acec-9e93572f2107 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:25.037832 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-40ddfa48-23ea-484c-acec-9e93572f2107 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:25.173765 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-40ddfa48-23ea-484c-acec-9e93572f2107 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:25.182185 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-40ddfa48-23ea-484c-acec-9e93572f2107 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1713 microversion: 2.1 time: 0.158427 May 26 15:13:25.182769 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 217/461] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:13:25 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1713 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:25.810394 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-932981a4-47bc-48f2-9ad6-3438f48ec120 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:25.810986 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-932981a4-47bc-48f2-9ad6-3438f48ec120 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 966278e6-017a-4267-a3b1-98edbcde5e16] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:25.817740 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-932981a4-47bc-48f2-9ad6-3438f48ec120 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:25.818181 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-932981a4-47bc-48f2-9ad6-3438f48ec120 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:25.818946 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-932981a4-47bc-48f2-9ad6-3438f48ec120 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:25.819408 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-932981a4-47bc-48f2-9ad6-3438f48ec120 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:25.820750 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-41e4872e-8601-46c6-8951-233b69e9326b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:25.821379 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-41e4872e-8601-46c6-8951-233b69e9326b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:25.828677 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-41e4872e-8601-46c6-8951-233b69e9326b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:25.829108 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-41e4872e-8601-46c6-8951-233b69e9326b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:25.829866 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-41e4872e-8601-46c6-8951-233b69e9326b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:25.830290 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-41e4872e-8601-46c6-8951-233b69e9326b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:26.022821 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-932981a4-47bc-48f2-9ad6-3438f48ec120 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:26.031234 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-41e4872e-8601-46c6-8951-233b69e9326b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:26.032840 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-932981a4-47bc-48f2-9ad6-3438f48ec120 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16" status: 200 len: 1366 microversion: 2.1 time: 0.227102 May 26 15:13:26.033430 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 245/462] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:13:25 2022] GET /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:26.040556 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-41e4872e-8601-46c6-8951-233b69e9326b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:26.042299 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-41e4872e-8601-46c6-8951-233b69e9326b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:26.043285 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-41e4872e-8601-46c6-8951-233b69e9326b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1744 microversion: 2.20 time: 0.226583 May 26 15:13:26.043849 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 218/463] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:25 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1744 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:27.052358 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-0b3fe9a5-9fad-42ed-a089-8ffc5d5fd52b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:27.052959 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-0b3fe9a5-9fad-42ed-a089-8ffc5d5fd52b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 966278e6-017a-4267-a3b1-98edbcde5e16] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:27.054789 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=4 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:13:27.061442 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0b3fe9a5-9fad-42ed-a089-8ffc5d5fd52b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:27.061885 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0b3fe9a5-9fad-42ed-a089-8ffc5d5fd52b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:27.062649 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0b3fe9a5-9fad-42ed-a089-8ffc5d5fd52b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:27.062913 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-47cad178-8ddf-43ed-af03-1a8425b5ec72 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:27.063392 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0b3fe9a5-9fad-42ed-a089-8ffc5d5fd52b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:27.063544 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-47cad178-8ddf-43ed-af03-1a8425b5ec72 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:27.070160 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-47cad178-8ddf-43ed-af03-1a8425b5ec72 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:27.070601 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-47cad178-8ddf-43ed-af03-1a8425b5ec72 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:27.071403 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-47cad178-8ddf-43ed-af03-1a8425b5ec72 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:27.071837 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-47cad178-8ddf-43ed-af03-1a8425b5ec72 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:27.280281 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-0b3fe9a5-9fad-42ed-a089-8ffc5d5fd52b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:27.284374 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-47cad178-8ddf-43ed-af03-1a8425b5ec72 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:27.291296 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-0b3fe9a5-9fad-42ed-a089-8ffc5d5fd52b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16" status: 200 len: 1556 microversion: 2.1 time: 0.242006 May 26 15:13:27.291930 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 246/464] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:13:27 2022] GET /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16 => generated 1556 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:27.295366 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-47cad178-8ddf-43ed-af03-1a8425b5ec72 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:27.297070 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-47cad178-8ddf-43ed-af03-1a8425b5ec72 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:27.298291 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-47cad178-8ddf-43ed-af03-1a8425b5ec72 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1739 microversion: 2.20 time: 0.239554 May 26 15:13:27.299212 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 219/465] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:27 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1739 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:27.308452 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-7aa3f5ff-3ab8-47a6-9459-aceed2383128 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:27.308948 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-7aa3f5ff-3ab8-47a6-9459-aceed2383128 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 966278e6-017a-4267-a3b1-98edbcde5e16] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:27.315753 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7aa3f5ff-3ab8-47a6-9459-aceed2383128 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:27.316199 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7aa3f5ff-3ab8-47a6-9459-aceed2383128 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:27.317019 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7aa3f5ff-3ab8-47a6-9459-aceed2383128 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:27.317485 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7aa3f5ff-3ab8-47a6-9459-aceed2383128 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:27.409505 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-7aa3f5ff-3ab8-47a6-9459-aceed2383128 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105257 May 26 15:13:27.410101 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 247/466] 10.222.0.45 () {58 vars in 1274 bytes} [Thu May 26 15:13:27 2022] GET /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:13:28.320402 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f74734da-1fde-47d5-8e2b-83fa80d6bc06 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:28.321948 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f74734da-1fde-47d5-8e2b-83fa80d6bc06 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:28.329856 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f74734da-1fde-47d5-8e2b-83fa80d6bc06 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:28.330759 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f74734da-1fde-47d5-8e2b-83fa80d6bc06 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:28.331862 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f74734da-1fde-47d5-8e2b-83fa80d6bc06 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:28.332623 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f74734da-1fde-47d5-8e2b-83fa80d6bc06 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:28.569006 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f74734da-1fde-47d5-8e2b-83fa80d6bc06 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:28.585426 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f74734da-1fde-47d5-8e2b-83fa80d6bc06 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:28.588393 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f74734da-1fde-47d5-8e2b-83fa80d6bc06 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:28.590251 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f74734da-1fde-47d5-8e2b-83fa80d6bc06 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1739 microversion: 2.20 time: 0.275637 May 26 15:13:28.602768 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 220/467] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:28 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1739 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:28.877569 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-d8c3159c-8d58-45ed-8526-0156e4747d71 req-1a4eddab-37c3-4514-83c5-59ea30fd746a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "966278e6-017a-4267-a3b1-98edbcde5e16", "tag": "dea2970b-0e07-4876-9293-c6e42ddeeac1"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:13:28.886016 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-d8c3159c-8d58-45ed-8526-0156e4747d71 req-1a4eddab-37c3-4514-83c5-59ea30fd746a service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:28.886747 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-d8c3159c-8d58-45ed-8526-0156e4747d71 req-1a4eddab-37c3-4514-83c5-59ea30fd746a service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:28.904567 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-d8c3159c-8d58-45ed-8526-0156e4747d71 req-1a4eddab-37c3-4514-83c5-59ea30fd746a service nova] Creating event network-changed:dea2970b-0e07-4876-9293-c6e42ddeeac1 for instance 966278e6-017a-4267-a3b1-98edbcde5e16 on hv-cinder-84301 May 26 15:13:28.911990 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-d8c3159c-8d58-45ed-8526-0156e4747d71 req-1a4eddab-37c3-4514-83c5-59ea30fd746a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038502 May 26 15:13:28.912973 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 248/468] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:13:29.609919 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-cf75180a-fc01-49ae-a62c-6540b6d6076d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:29.611182 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-cf75180a-fc01-49ae-a62c-6540b6d6076d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:29.618383 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cf75180a-fc01-49ae-a62c-6540b6d6076d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:29.619348 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cf75180a-fc01-49ae-a62c-6540b6d6076d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:29.620508 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cf75180a-fc01-49ae-a62c-6540b6d6076d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:29.621243 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cf75180a-fc01-49ae-a62c-6540b6d6076d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:29.802674 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-cf75180a-fc01-49ae-a62c-6540b6d6076d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:29.812621 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-cf75180a-fc01-49ae-a62c-6540b6d6076d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:29.814504 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-cf75180a-fc01-49ae-a62c-6540b6d6076d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:29.816064 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-cf75180a-fc01-49ae-a62c-6540b6d6076d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1739 microversion: 2.20 time: 0.210012 May 26 15:13:29.829177 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 221/469] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:29 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1739 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:30.838859 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-f7126074-63b4-4b78-b26f-3c91a161b80b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:30.839938 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-f7126074-63b4-4b78-b26f-3c91a161b80b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:30.846547 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f7126074-63b4-4b78-b26f-3c91a161b80b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:30.846996 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f7126074-63b4-4b78-b26f-3c91a161b80b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:30.847800 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f7126074-63b4-4b78-b26f-3c91a161b80b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:30.848262 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f7126074-63b4-4b78-b26f-3c91a161b80b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:31.012777 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-f7126074-63b4-4b78-b26f-3c91a161b80b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:31.017278 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:13:31.026066 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-f7126074-63b4-4b78-b26f-3c91a161b80b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:31.028345 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-f7126074-63b4-4b78-b26f-3c91a161b80b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:31.029711 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-f7126074-63b4-4b78-b26f-3c91a161b80b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1739 microversion: 2.20 time: 0.196768 May 26 15:13:31.030358 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 249/470] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:30 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1739 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:32.048335 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a7497aff-6a23-473c-aa05-0f9855e25988 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:32.049198 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a7497aff-6a23-473c-aa05-0f9855e25988 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:32.055875 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a7497aff-6a23-473c-aa05-0f9855e25988 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:32.056827 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a7497aff-6a23-473c-aa05-0f9855e25988 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:32.057473 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a7497aff-6a23-473c-aa05-0f9855e25988 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:32.057899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a7497aff-6a23-473c-aa05-0f9855e25988 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:32.221923 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a7497aff-6a23-473c-aa05-0f9855e25988 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:32.231449 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a7497aff-6a23-473c-aa05-0f9855e25988 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:32.232962 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a7497aff-6a23-473c-aa05-0f9855e25988 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:32.234138 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a7497aff-6a23-473c-aa05-0f9855e25988 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1739 microversion: 2.20 time: 0.189836 May 26 15:13:32.234717 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 222/471] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:32 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:13:33.254643 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-dfffb14d-3d44-4c0f-9697-579eb457d2f0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:33.255571 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-dfffb14d-3d44-4c0f-9697-579eb457d2f0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:33.264492 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dfffb14d-3d44-4c0f-9697-579eb457d2f0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:33.264944 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dfffb14d-3d44-4c0f-9697-579eb457d2f0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:33.265728 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dfffb14d-3d44-4c0f-9697-579eb457d2f0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:33.266170 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dfffb14d-3d44-4c0f-9697-579eb457d2f0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:33.445931 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-dfffb14d-3d44-4c0f-9697-579eb457d2f0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:33.461025 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-dfffb14d-3d44-4c0f-9697-579eb457d2f0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:33.462776 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-dfffb14d-3d44-4c0f-9697-579eb457d2f0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:33.464015 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-dfffb14d-3d44-4c0f-9697-579eb457d2f0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1739 microversion: 2.20 time: 0.214910 May 26 15:13:33.464909 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 250/472] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:33 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1739 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:34.485826 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ff92b0ef-67cf-4c43-b88a-22d16d066a85 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:34.487228 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ff92b0ef-67cf-4c43-b88a-22d16d066a85 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:34.496913 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ff92b0ef-67cf-4c43-b88a-22d16d066a85 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:34.498346 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ff92b0ef-67cf-4c43-b88a-22d16d066a85 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:34.499044 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ff92b0ef-67cf-4c43-b88a-22d16d066a85 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:34.499722 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ff92b0ef-67cf-4c43-b88a-22d16d066a85 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:34.646836 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ff92b0ef-67cf-4c43-b88a-22d16d066a85 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:34.655857 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ff92b0ef-67cf-4c43-b88a-22d16d066a85 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:34.657410 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ff92b0ef-67cf-4c43-b88a-22d16d066a85 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:34.658591 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ff92b0ef-67cf-4c43-b88a-22d16d066a85 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1739 microversion: 2.20 time: 0.176766 May 26 15:13:34.659373 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 223/473] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:34 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:35.677489 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-76bb4f0e-eb3a-4de5-8d7f-c68a537760b6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:35.678152 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-76bb4f0e-eb3a-4de5-8d7f-c68a537760b6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:35.686003 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-76bb4f0e-eb3a-4de5-8d7f-c68a537760b6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:35.686464 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-76bb4f0e-eb3a-4de5-8d7f-c68a537760b6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:35.687288 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-76bb4f0e-eb3a-4de5-8d7f-c68a537760b6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:35.687729 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-76bb4f0e-eb3a-4de5-8d7f-c68a537760b6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:35.844431 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-76bb4f0e-eb3a-4de5-8d7f-c68a537760b6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:35.857374 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-76bb4f0e-eb3a-4de5-8d7f-c68a537760b6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:35.859528 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-76bb4f0e-eb3a-4de5-8d7f-c68a537760b6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:35.860945 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-76bb4f0e-eb3a-4de5-8d7f-c68a537760b6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1739 microversion: 2.20 time: 0.187488 May 26 15:13:35.873924 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 251/474] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:35 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:36.880599 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b05d5b0c-73ba-4c64-88a0-5278bc75e56c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:36.881241 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b05d5b0c-73ba-4c64-88a0-5278bc75e56c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:36.888081 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b05d5b0c-73ba-4c64-88a0-5278bc75e56c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:36.888535 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b05d5b0c-73ba-4c64-88a0-5278bc75e56c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:36.889325 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b05d5b0c-73ba-4c64-88a0-5278bc75e56c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:36.889769 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b05d5b0c-73ba-4c64-88a0-5278bc75e56c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:37.048455 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b05d5b0c-73ba-4c64-88a0-5278bc75e56c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:37.057560 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b05d5b0c-73ba-4c64-88a0-5278bc75e56c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:37.059127 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b05d5b0c-73ba-4c64-88a0-5278bc75e56c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:37.060359 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b05d5b0c-73ba-4c64-88a0-5278bc75e56c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1739 microversion: 2.20 time: 0.183939 May 26 15:13:37.060938 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 224/475] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:36 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:38.078882 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-502d6c84-0945-4949-855b-8525c2132540 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:38.079601 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-502d6c84-0945-4949-855b-8525c2132540 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:38.087213 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-502d6c84-0945-4949-855b-8525c2132540 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:38.088333 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-502d6c84-0945-4949-855b-8525c2132540 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:38.089104 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-502d6c84-0945-4949-855b-8525c2132540 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:38.089536 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-502d6c84-0945-4949-855b-8525c2132540 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:38.235557 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-502d6c84-0945-4949-855b-8525c2132540 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:38.243724 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-502d6c84-0945-4949-855b-8525c2132540 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:38.245234 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-502d6c84-0945-4949-855b-8525c2132540 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:38.246399 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-502d6c84-0945-4949-855b-8525c2132540 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1739 microversion: 2.20 time: 0.171489 May 26 15:13:38.246954 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 252/476] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:38 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:39.265737 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ada73de1-61f3-4430-9ec0-7f1ed5b51ac4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:39.266370 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ada73de1-61f3-4430-9ec0-7f1ed5b51ac4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:39.273301 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ada73de1-61f3-4430-9ec0-7f1ed5b51ac4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:39.273766 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ada73de1-61f3-4430-9ec0-7f1ed5b51ac4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:39.275149 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ada73de1-61f3-4430-9ec0-7f1ed5b51ac4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:39.275589 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ada73de1-61f3-4430-9ec0-7f1ed5b51ac4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:39.435844 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ada73de1-61f3-4430-9ec0-7f1ed5b51ac4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:39.444930 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ada73de1-61f3-4430-9ec0-7f1ed5b51ac4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:39.447743 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ada73de1-61f3-4430-9ec0-7f1ed5b51ac4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:39.448715 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ada73de1-61f3-4430-9ec0-7f1ed5b51ac4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1721 microversion: 2.20 time: 0.187422 May 26 15:13:39.449557 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 225/477] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:39 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:40.468924 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-8e4fad94-bb43-4059-a641-1d7feddf3b32 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:40.469557 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-8e4fad94-bb43-4059-a641-1d7feddf3b32 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:40.476087 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8e4fad94-bb43-4059-a641-1d7feddf3b32 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:40.476540 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8e4fad94-bb43-4059-a641-1d7feddf3b32 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:40.477470 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8e4fad94-bb43-4059-a641-1d7feddf3b32 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:40.477908 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8e4fad94-bb43-4059-a641-1d7feddf3b32 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:40.737598 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-8e4fad94-bb43-4059-a641-1d7feddf3b32 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:40.745816 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-8e4fad94-bb43-4059-a641-1d7feddf3b32 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:40.747345 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-8e4fad94-bb43-4059-a641-1d7feddf3b32 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:40.748498 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-8e4fad94-bb43-4059-a641-1d7feddf3b32 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1721 microversion: 2.20 time: 0.283573 May 26 15:13:40.749045 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 253/478] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:40 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1721 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:41.768746 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-edbb4670-3a48-4181-ab10-76305eebd42a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:41.769361 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-edbb4670-3a48-4181-ab10-76305eebd42a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:41.776512 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-edbb4670-3a48-4181-ab10-76305eebd42a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:41.776963 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-edbb4670-3a48-4181-ab10-76305eebd42a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:41.777859 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-edbb4670-3a48-4181-ab10-76305eebd42a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:41.778298 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-edbb4670-3a48-4181-ab10-76305eebd42a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:41.985645 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-edbb4670-3a48-4181-ab10-76305eebd42a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:41.995895 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-edbb4670-3a48-4181-ab10-76305eebd42a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:41.997613 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-edbb4670-3a48-4181-ab10-76305eebd42a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:41.998825 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-edbb4670-3a48-4181-ab10-76305eebd42a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1721 microversion: 2.20 time: 0.234350 May 26 15:13:41.999415 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 226/479] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:41 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1721 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:42.361727 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-0c6d9cfb-9829-4c05-b3f0-d974fc292c8a req-b3244c1f-ccfd-4759-aa00-aa0bb818ec48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6", "name": "network-vif-unplugged", "status": "completed", "tag": "6342ec5c-6f4f-42ae-aaeb-2f79c05fef02"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:13:42.372891 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-0c6d9cfb-9829-4c05-b3f0-d974fc292c8a req-b3244c1f-ccfd-4759-aa00-aa0bb818ec48 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:42.373693 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-0c6d9cfb-9829-4c05-b3f0-d974fc292c8a req-b3244c1f-ccfd-4759-aa00-aa0bb818ec48 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:42.389420 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.compute.server_external_events [req-0c6d9cfb-9829-4c05-b3f0-d974fc292c8a req-b3244c1f-ccfd-4759-aa00-aa0bb818ec48 service nova] Unable to find a host for instance 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6. Dropping event network-vif-unplugged {{(pid=117799) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 26 15:13:42.390601 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-0c6d9cfb-9829-4c05-b3f0-d974fc292c8a req-b3244c1f-ccfd-4759-aa00-aa0bb818ec48 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032774 May 26 15:13:42.391379 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 254/480] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 26 15:13:43.017863 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-2a286f25-30c8-4199-b348-01d27fab8d3d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:43.018456 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-2a286f25-30c8-4199-b348-01d27fab8d3d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:43.026329 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2a286f25-30c8-4199-b348-01d27fab8d3d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:43.026693 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2a286f25-30c8-4199-b348-01d27fab8d3d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:43.027519 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2a286f25-30c8-4199-b348-01d27fab8d3d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:43.027955 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2a286f25-30c8-4199-b348-01d27fab8d3d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:43.170005 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2a286f25-30c8-4199-b348-01d27fab8d3d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:43.178361 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2a286f25-30c8-4199-b348-01d27fab8d3d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:43.179905 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2a286f25-30c8-4199-b348-01d27fab8d3d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:43.181585 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-2a286f25-30c8-4199-b348-01d27fab8d3d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1664 microversion: 2.20 time: 0.167673 May 26 15:13:43.182150 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 227/481] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:43 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1664 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:43.199983 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-b6ec6b71-9e91-4793-b5ee-0890cbf03b1c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da502465-486d-46f9-a6e2-e56912980856"}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:13:43.201031 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-b6ec6b71-9e91-4793-b5ee-0890cbf03b1c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:43.207200 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b6ec6b71-9e91-4793-b5ee-0890cbf03b1c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:43.207660 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b6ec6b71-9e91-4793-b5ee-0890cbf03b1c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:43.208435 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b6ec6b71-9e91-4793-b5ee-0890cbf03b1c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:43.208867 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b6ec6b71-9e91-4793-b5ee-0890cbf03b1c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:43.501682 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-b6ec6b71-9e91-4793-b5ee-0890cbf03b1c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "POST /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.306248 May 26 15:13:43.502498 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 255/482] 10.222.0.45 () {62 vars in 1363 bytes} [Thu May 26 15:13:43 2022] POST /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6/os-volume_attachments => generated 188 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:13:43.624573 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-8a676bd2-43d4-4417-8b10-22db04b7e1c7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:13:43.625179 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-8a676bd2-43d4-4417-8b10-22db04b7e1c7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:43.631577 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8a676bd2-43d4-4417-8b10-22db04b7e1c7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:43.632023 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8a676bd2-43d4-4417-8b10-22db04b7e1c7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:43.632812 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8a676bd2-43d4-4417-8b10-22db04b7e1c7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:43.633238 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8a676bd2-43d4-4417-8b10-22db04b7e1c7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:43.774898 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-8a676bd2-43d4-4417-8b10-22db04b7e1c7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "POST /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6/action" status: 202 len: 0 microversion: 2.20 time: 0.153380 May 26 15:13:43.775523 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 228/483] 10.222.0.45 () {62 vars in 1318 bytes} [Thu May 26 15:13:43 2022] POST /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 15:13:43.783487 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-545addcd-6c82-44ac-80fe-0b8a89c25560 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:43.784094 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-545addcd-6c82-44ac-80fe-0b8a89c25560 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:43.790411 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-545addcd-6c82-44ac-80fe-0b8a89c25560 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:43.790858 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-545addcd-6c82-44ac-80fe-0b8a89c25560 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:43.791683 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-545addcd-6c82-44ac-80fe-0b8a89c25560 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:43.792119 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-545addcd-6c82-44ac-80fe-0b8a89c25560 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:43.942140 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-545addcd-6c82-44ac-80fe-0b8a89c25560 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:43.953540 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-545addcd-6c82-44ac-80fe-0b8a89c25560 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:43.955176 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-545addcd-6c82-44ac-80fe-0b8a89c25560 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:43.956345 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-545addcd-6c82-44ac-80fe-0b8a89c25560 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1750 microversion: 2.20 time: 0.176716 May 26 15:13:43.956901 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 256/484] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:43 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1750 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:44.975648 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-4415bd03-6a9d-45bd-9cc2-fbecd56feefc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:44.976245 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-4415bd03-6a9d-45bd-9cc2-fbecd56feefc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:44.985433 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4415bd03-6a9d-45bd-9cc2-fbecd56feefc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:44.985886 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4415bd03-6a9d-45bd-9cc2-fbecd56feefc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:44.986667 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4415bd03-6a9d-45bd-9cc2-fbecd56feefc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:44.987180 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4415bd03-6a9d-45bd-9cc2-fbecd56feefc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:45.125026 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-4415bd03-6a9d-45bd-9cc2-fbecd56feefc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:45.133844 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-4415bd03-6a9d-45bd-9cc2-fbecd56feefc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:45.135488 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-4415bd03-6a9d-45bd-9cc2-fbecd56feefc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:45.136650 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-4415bd03-6a9d-45bd-9cc2-fbecd56feefc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1752 microversion: 2.20 time: 0.164950 May 26 15:13:45.137207 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 229/485] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:44 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:46.155668 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-c93353d9-f384-47d9-a4b6-b6bc48eda343 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:46.156396 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-c93353d9-f384-47d9-a4b6-b6bc48eda343 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:46.163427 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c93353d9-f384-47d9-a4b6-b6bc48eda343 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:46.163871 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c93353d9-f384-47d9-a4b6-b6bc48eda343 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:46.164792 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c93353d9-f384-47d9-a4b6-b6bc48eda343 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:46.165510 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c93353d9-f384-47d9-a4b6-b6bc48eda343 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:46.307782 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-c93353d9-f384-47d9-a4b6-b6bc48eda343 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:46.318017 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-c93353d9-f384-47d9-a4b6-b6bc48eda343 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:46.319743 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-c93353d9-f384-47d9-a4b6-b6bc48eda343 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:46.322250 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-c93353d9-f384-47d9-a4b6-b6bc48eda343 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1808 microversion: 2.20 time: 0.170195 May 26 15:13:46.322905 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 257/486] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:46 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:47.345455 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e2240991-864f-4af6-bf97-1fdce15d8746 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:47.346949 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e2240991-864f-4af6-bf97-1fdce15d8746 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:47.356783 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e2240991-864f-4af6-bf97-1fdce15d8746 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:47.357832 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e2240991-864f-4af6-bf97-1fdce15d8746 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:47.359359 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e2240991-864f-4af6-bf97-1fdce15d8746 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:47.360392 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e2240991-864f-4af6-bf97-1fdce15d8746 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:47.617106 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e2240991-864f-4af6-bf97-1fdce15d8746 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:47.627167 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e2240991-864f-4af6-bf97-1fdce15d8746 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:47.628904 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e2240991-864f-4af6-bf97-1fdce15d8746 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:47.630183 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e2240991-864f-4af6-bf97-1fdce15d8746 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1808 microversion: 2.20 time: 0.291491 May 26 15:13:47.630800 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 230/487] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:47 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1808 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:48.650062 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-18978dc1-0e4c-43ec-a1d2-4e203716ffcd tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:48.650757 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-18978dc1-0e4c-43ec-a1d2-4e203716ffcd tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:48.656946 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-18978dc1-0e4c-43ec-a1d2-4e203716ffcd tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:48.657389 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-18978dc1-0e4c-43ec-a1d2-4e203716ffcd tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:48.658155 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-18978dc1-0e4c-43ec-a1d2-4e203716ffcd tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:48.658591 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-18978dc1-0e4c-43ec-a1d2-4e203716ffcd tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:48.799918 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-18978dc1-0e4c-43ec-a1d2-4e203716ffcd tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:48.809493 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-18978dc1-0e4c-43ec-a1d2-4e203716ffcd tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:48.811221 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-18978dc1-0e4c-43ec-a1d2-4e203716ffcd tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:48.812387 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-18978dc1-0e4c-43ec-a1d2-4e203716ffcd tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1808 microversion: 2.20 time: 0.166256 May 26 15:13:48.812951 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 258/488] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:48 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:49.830840 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-38c5e787-80ae-4714-84c4-23a4b5c13cd1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:49.831499 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-38c5e787-80ae-4714-84c4-23a4b5c13cd1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:49.838720 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-38c5e787-80ae-4714-84c4-23a4b5c13cd1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:49.839200 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-38c5e787-80ae-4714-84c4-23a4b5c13cd1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:49.839966 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-38c5e787-80ae-4714-84c4-23a4b5c13cd1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:49.840398 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-38c5e787-80ae-4714-84c4-23a4b5c13cd1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:49.844955 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:13:49.991809 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-38c5e787-80ae-4714-84c4-23a4b5c13cd1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:50.001280 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-38c5e787-80ae-4714-84c4-23a4b5c13cd1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:50.002804 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-38c5e787-80ae-4714-84c4-23a4b5c13cd1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:50.004003 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-38c5e787-80ae-4714-84c4-23a4b5c13cd1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1808 microversion: 2.20 time: 0.177052 May 26 15:13:50.004566 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 231/489] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:49 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:51.024315 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-098417e1-63c2-4528-bdb4-39093ba6ddf9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:51.025032 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-098417e1-63c2-4528-bdb4-39093ba6ddf9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:51.031952 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-098417e1-63c2-4528-bdb4-39093ba6ddf9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:51.033205 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-098417e1-63c2-4528-bdb4-39093ba6ddf9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:51.034403 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-098417e1-63c2-4528-bdb4-39093ba6ddf9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:51.034855 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-098417e1-63c2-4528-bdb4-39093ba6ddf9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:51.185653 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-098417e1-63c2-4528-bdb4-39093ba6ddf9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:51.194017 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-098417e1-63c2-4528-bdb4-39093ba6ddf9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:51.195519 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-098417e1-63c2-4528-bdb4-39093ba6ddf9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:51.197309 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-098417e1-63c2-4528-bdb4-39093ba6ddf9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1808 microversion: 2.20 time: 0.178058 May 26 15:13:51.197861 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 259/490] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:51 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:52.216036 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-05538cff-471b-4b7e-9fa1-85e33130b394 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:52.216674 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-05538cff-471b-4b7e-9fa1-85e33130b394 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:52.223804 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-05538cff-471b-4b7e-9fa1-85e33130b394 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:52.224152 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-05538cff-471b-4b7e-9fa1-85e33130b394 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:52.224919 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-05538cff-471b-4b7e-9fa1-85e33130b394 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:52.225342 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-05538cff-471b-4b7e-9fa1-85e33130b394 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:52.404754 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-05538cff-471b-4b7e-9fa1-85e33130b394 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:52.416538 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-05538cff-471b-4b7e-9fa1-85e33130b394 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:52.418566 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-05538cff-471b-4b7e-9fa1-85e33130b394 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:52.420771 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-05538cff-471b-4b7e-9fa1-85e33130b394 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1808 microversion: 2.20 time: 0.209124 May 26 15:13:52.421723 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 232/491] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:52 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1808 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:53.445143 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-f9b601c0-1ce4-47de-9a15-caa269392787 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:53.446507 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-f9b601c0-1ce4-47de-9a15-caa269392787 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:53.452885 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f9b601c0-1ce4-47de-9a15-caa269392787 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:53.453377 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f9b601c0-1ce4-47de-9a15-caa269392787 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:53.454109 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f9b601c0-1ce4-47de-9a15-caa269392787 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:53.454545 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f9b601c0-1ce4-47de-9a15-caa269392787 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:53.519371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-34d3fa11-9739-420e-a7d7-46975a051c80 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "379451d7-a770-42a0-993a-d1c20a7a8f27"}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:13:53.521074 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-34d3fa11-9739-420e-a7d7-46975a051c80 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:53.527961 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-34d3fa11-9739-420e-a7d7-46975a051c80 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:53.528907 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-34d3fa11-9739-420e-a7d7-46975a051c80 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:53.529696 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-34d3fa11-9739-420e-a7d7-46975a051c80 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:53.530136 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-34d3fa11-9739-420e-a7d7-46975a051c80 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:53.597562 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-f9b601c0-1ce4-47de-9a15-caa269392787 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:53.613039 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-f9b601c0-1ce4-47de-9a15-caa269392787 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:53.614535 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-f9b601c0-1ce4-47de-9a15-caa269392787 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:53.615736 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-f9b601c0-1ce4-47de-9a15-caa269392787 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1808 microversion: 2.20 time: 0.174552 May 26 15:13:53.616281 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 260/492] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:53 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:13:54.639397 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-c65748bc-b8a3-46f9-aa26-b5f1a15d5143 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:54.640166 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-c65748bc-b8a3-46f9-aa26-b5f1a15d5143 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:54.646736 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c65748bc-b8a3-46f9-aa26-b5f1a15d5143 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:54.647218 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c65748bc-b8a3-46f9-aa26-b5f1a15d5143 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:54.647969 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c65748bc-b8a3-46f9-aa26-b5f1a15d5143 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:54.648399 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c65748bc-b8a3-46f9-aa26-b5f1a15d5143 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:54.790125 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-c65748bc-b8a3-46f9-aa26-b5f1a15d5143 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:54.799965 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-c65748bc-b8a3-46f9-aa26-b5f1a15d5143 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:54.801594 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-c65748bc-b8a3-46f9-aa26-b5f1a15d5143 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:54.802880 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-c65748bc-b8a3-46f9-aa26-b5f1a15d5143 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1808 microversion: 2.20 time: 0.167339 May 26 15:13:54.803551 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 261/493] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:54 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:13:55.822730 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-4fe1e2be-bdc7-4656-87db-8fdb5b685310 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:55.823523 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-4fe1e2be-bdc7-4656-87db-8fdb5b685310 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:55.829839 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4fe1e2be-bdc7-4656-87db-8fdb5b685310 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:55.830290 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4fe1e2be-bdc7-4656-87db-8fdb5b685310 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:55.831049 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4fe1e2be-bdc7-4656-87db-8fdb5b685310 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:55.831507 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4fe1e2be-bdc7-4656-87db-8fdb5b685310 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:55.972497 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-4fe1e2be-bdc7-4656-87db-8fdb5b685310 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:55.981151 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-4fe1e2be-bdc7-4656-87db-8fdb5b685310 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:55.982647 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-4fe1e2be-bdc7-4656-87db-8fdb5b685310 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:55.983846 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-4fe1e2be-bdc7-4656-87db-8fdb5b685310 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1808 microversion: 2.20 time: 0.165550 May 26 15:13:55.984417 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 262/494] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:55 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:13:57.003465 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-9b55734a-ae4d-4283-9240-a4f452f9fb60 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:57.004303 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-9b55734a-ae4d-4283-9240-a4f452f9fb60 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:57.012734 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9b55734a-ae4d-4283-9240-a4f452f9fb60 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:57.013268 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9b55734a-ae4d-4283-9240-a4f452f9fb60 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:57.014138 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9b55734a-ae4d-4283-9240-a4f452f9fb60 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:57.014630 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9b55734a-ae4d-4283-9240-a4f452f9fb60 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:57.146479 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-9b55734a-ae4d-4283-9240-a4f452f9fb60 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:57.156139 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-9b55734a-ae4d-4283-9240-a4f452f9fb60 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:57.157623 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-9b55734a-ae4d-4283-9240-a4f452f9fb60 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:57.158760 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-9b55734a-ae4d-4283-9240-a4f452f9fb60 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1808 microversion: 2.20 time: 0.160185 May 26 15:13:57.159356 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 263/495] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:56 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:13:58.177752 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-d784508f-63f8-4f62-827d-cc378768241e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:58.178451 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-d784508f-63f8-4f62-827d-cc378768241e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:58.181555 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_api:SELECT=36 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:13:58.187042 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d784508f-63f8-4f62-827d-cc378768241e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:58.187520 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d784508f-63f8-4f62-827d-cc378768241e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:58.188287 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d784508f-63f8-4f62-827d-cc378768241e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:58.188717 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d784508f-63f8-4f62-827d-cc378768241e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:58.207449 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:13:58.350359 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-d784508f-63f8-4f62-827d-cc378768241e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:58.359599 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-d784508f-63f8-4f62-827d-cc378768241e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:58.361100 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-d784508f-63f8-4f62-827d-cc378768241e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:58.362266 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-d784508f-63f8-4f62-827d-cc378768241e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1808 microversion: 2.20 time: 0.188451 May 26 15:13:58.362831 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 264/496] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:58 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:13:59.381745 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-05d6e576-b875-46f8-92b3-d752f9dd5c03 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:59.382407 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-05d6e576-b875-46f8-92b3-d752f9dd5c03 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:59.389728 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-05d6e576-b875-46f8-92b3-d752f9dd5c03 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:59.390175 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-05d6e576-b875-46f8-92b3-d752f9dd5c03 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:59.390939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-05d6e576-b875-46f8-92b3-d752f9dd5c03 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:59.391399 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-05d6e576-b875-46f8-92b3-d752f9dd5c03 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:59.533251 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-05d6e576-b875-46f8-92b3-d752f9dd5c03 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:59.541848 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-05d6e576-b875-46f8-92b3-d752f9dd5c03 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:59.543376 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-05d6e576-b875-46f8-92b3-d752f9dd5c03 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:59.544533 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-05d6e576-b875-46f8-92b3-d752f9dd5c03 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1808 microversion: 2.20 time: 0.167022 May 26 15:13:59.545090 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 265/497] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:13:59 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:14:00.564066 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-e5b95ed5-f08b-4c80-b729-3dd5ed358d3c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:00.564751 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-e5b95ed5-f08b-4c80-b729-3dd5ed358d3c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:00.571839 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e5b95ed5-f08b-4c80-b729-3dd5ed358d3c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:00.572290 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e5b95ed5-f08b-4c80-b729-3dd5ed358d3c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:00.573060 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e5b95ed5-f08b-4c80-b729-3dd5ed358d3c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:00.573494 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e5b95ed5-f08b-4c80-b729-3dd5ed358d3c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:00.800026 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-e5b95ed5-f08b-4c80-b729-3dd5ed358d3c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:00.809363 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-e5b95ed5-f08b-4c80-b729-3dd5ed358d3c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:00.810974 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-e5b95ed5-f08b-4c80-b729-3dd5ed358d3c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:00.812191 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-e5b95ed5-f08b-4c80-b729-3dd5ed358d3c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1808 microversion: 2.20 time: 0.252076 May 26 15:14:00.812753 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 266/498] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:14:00 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1808 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:14:01.833416 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-2a2048d1-bf9f-4686-bfec-f35d80370723 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:01.834108 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-2a2048d1-bf9f-4686-bfec-f35d80370723 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:01.842471 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2a2048d1-bf9f-4686-bfec-f35d80370723 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:01.842915 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2a2048d1-bf9f-4686-bfec-f35d80370723 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:01.843726 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2a2048d1-bf9f-4686-bfec-f35d80370723 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:01.844165 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2a2048d1-bf9f-4686-bfec-f35d80370723 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:01.982672 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-2a2048d1-bf9f-4686-bfec-f35d80370723 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:01.990931 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-2a2048d1-bf9f-4686-bfec-f35d80370723 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:01.992662 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-2a2048d1-bf9f-4686-bfec-f35d80370723 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:01.994331 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-2a2048d1-bf9f-4686-bfec-f35d80370723 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1808 microversion: 2.20 time: 0.166094 May 26 15:14:01.995106 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 267/499] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:14:01 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:14:03.013397 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-47225177-0434-4a7e-b3a3-720d48cb87c9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:03.014153 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-47225177-0434-4a7e-b3a3-720d48cb87c9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:03.021086 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-47225177-0434-4a7e-b3a3-720d48cb87c9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:03.021522 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-47225177-0434-4a7e-b3a3-720d48cb87c9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:03.022290 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-47225177-0434-4a7e-b3a3-720d48cb87c9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:03.023152 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-47225177-0434-4a7e-b3a3-720d48cb87c9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:03.166601 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-47225177-0434-4a7e-b3a3-720d48cb87c9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:03.176105 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-47225177-0434-4a7e-b3a3-720d48cb87c9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:03.177600 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-47225177-0434-4a7e-b3a3-720d48cb87c9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:03.178799 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-47225177-0434-4a7e-b3a3-720d48cb87c9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1808 microversion: 2.20 time: 0.169469 May 26 15:14:03.179391 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 268/500] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:14:03 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:14:03.527142 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=35 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:14:03.614600 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=16 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:14:04.198819 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-459dd004-51d5-4f04-a1e4-26aca57dc7b0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:04.199583 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-459dd004-51d5-4f04-a1e4-26aca57dc7b0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:04.206209 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-459dd004-51d5-4f04-a1e4-26aca57dc7b0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:04.206651 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-459dd004-51d5-4f04-a1e4-26aca57dc7b0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:04.207459 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-459dd004-51d5-4f04-a1e4-26aca57dc7b0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:04.207889 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-459dd004-51d5-4f04-a1e4-26aca57dc7b0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:04.344733 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-459dd004-51d5-4f04-a1e4-26aca57dc7b0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:04.353442 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-459dd004-51d5-4f04-a1e4-26aca57dc7b0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:04.354935 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-459dd004-51d5-4f04-a1e4-26aca57dc7b0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:04.356141 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-459dd004-51d5-4f04-a1e4-26aca57dc7b0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1808 microversion: 2.20 time: 0.162244 May 26 15:14:04.356712 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 269/501] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:14:04 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:14:04.924129 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-34d3fa11-9739-420e-a7d7-46975a051c80 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "POST /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 11.408625 May 26 15:14:04.924776 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 233/502] 10.222.0.45 () {60 vars in 1322 bytes} [Thu May 26 15:13:53 2022] POST /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b/os-volume_attachments => generated 194 bytes in 11410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:14:05.374717 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-41417fbd-e162-4eec-ba58-7d12e5d33bd1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:05.375395 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-41417fbd-e162-4eec-ba58-7d12e5d33bd1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:05.382090 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-41417fbd-e162-4eec-ba58-7d12e5d33bd1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:05.382544 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-41417fbd-e162-4eec-ba58-7d12e5d33bd1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:05.383473 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-41417fbd-e162-4eec-ba58-7d12e5d33bd1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:05.383909 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-41417fbd-e162-4eec-ba58-7d12e5d33bd1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:05.518723 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-41417fbd-e162-4eec-ba58-7d12e5d33bd1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:05.528949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-41417fbd-e162-4eec-ba58-7d12e5d33bd1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:05.530421 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-41417fbd-e162-4eec-ba58-7d12e5d33bd1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:05.531605 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-41417fbd-e162-4eec-ba58-7d12e5d33bd1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1808 microversion: 2.20 time: 0.161165 May 26 15:14:05.532159 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 270/503] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:14:05 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:14:06.552088 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f20e50b0-33d6-4c64-a4c0-52c66b8f8ca4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:06.552781 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f20e50b0-33d6-4c64-a4c0-52c66b8f8ca4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:06.560790 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f20e50b0-33d6-4c64-a4c0-52c66b8f8ca4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:06.561242 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f20e50b0-33d6-4c64-a4c0-52c66b8f8ca4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:06.562029 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f20e50b0-33d6-4c64-a4c0-52c66b8f8ca4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:06.562467 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f20e50b0-33d6-4c64-a4c0-52c66b8f8ca4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:06.703323 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f20e50b0-33d6-4c64-a4c0-52c66b8f8ca4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:06.712528 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f20e50b0-33d6-4c64-a4c0-52c66b8f8ca4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:06.714018 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f20e50b0-33d6-4c64-a4c0-52c66b8f8ca4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:06.715251 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f20e50b0-33d6-4c64-a4c0-52c66b8f8ca4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1808 microversion: 2.20 time: 0.167509 May 26 15:14:06.715822 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 234/504] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:14:06 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:14:07.733840 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-0c5ac27a-7d41-41de-9c19-553ae12b3912 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:07.734445 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-0c5ac27a-7d41-41de-9c19-553ae12b3912 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:07.741248 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0c5ac27a-7d41-41de-9c19-553ae12b3912 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:07.741690 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0c5ac27a-7d41-41de-9c19-553ae12b3912 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:07.743206 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0c5ac27a-7d41-41de-9c19-553ae12b3912 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:07.743644 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0c5ac27a-7d41-41de-9c19-553ae12b3912 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:07.888260 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-0c5ac27a-7d41-41de-9c19-553ae12b3912 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:07.897007 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-0c5ac27a-7d41-41de-9c19-553ae12b3912 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:07.898516 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-0c5ac27a-7d41-41de-9c19-553ae12b3912 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:07.899705 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-0c5ac27a-7d41-41de-9c19-553ae12b3912 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1808 microversion: 2.20 time: 0.169776 May 26 15:14:07.900262 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 271/505] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:14:07 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:14:08.918627 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-79e200b9-91b3-4d29-8141-464792a8b7ac tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:08.919262 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-79e200b9-91b3-4d29-8141-464792a8b7ac tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:08.925878 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-79e200b9-91b3-4d29-8141-464792a8b7ac tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:08.926360 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-79e200b9-91b3-4d29-8141-464792a8b7ac tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:08.927160 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-79e200b9-91b3-4d29-8141-464792a8b7ac tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:08.927596 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-79e200b9-91b3-4d29-8141-464792a8b7ac tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:09.065567 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-79e200b9-91b3-4d29-8141-464792a8b7ac tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:09.075284 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-79e200b9-91b3-4d29-8141-464792a8b7ac tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:09.076796 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-79e200b9-91b3-4d29-8141-464792a8b7ac tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:09.077972 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-79e200b9-91b3-4d29-8141-464792a8b7ac tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1808 microversion: 2.20 time: 0.163316 May 26 15:14:09.078540 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 235/506] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:14:08 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:14:10.096788 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-97318fc1-5110-415a-874e-36a432226519 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:10.097396 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-97318fc1-5110-415a-874e-36a432226519 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:10.104878 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-97318fc1-5110-415a-874e-36a432226519 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:10.105362 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-97318fc1-5110-415a-874e-36a432226519 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:10.106133 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-97318fc1-5110-415a-874e-36a432226519 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:10.106608 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-97318fc1-5110-415a-874e-36a432226519 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:10.254762 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-97318fc1-5110-415a-874e-36a432226519 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:10.265635 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-97318fc1-5110-415a-874e-36a432226519 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:10.267134 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-97318fc1-5110-415a-874e-36a432226519 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:10.268291 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-97318fc1-5110-415a-874e-36a432226519 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1808 microversion: 2.20 time: 0.175428 May 26 15:14:10.269045 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 272/507] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:14:10 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:14:11.287910 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-15094287-49a4-48ac-9cc5-b5ff1e55a6fc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:11.288516 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-15094287-49a4-48ac-9cc5-b5ff1e55a6fc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:11.295707 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-15094287-49a4-48ac-9cc5-b5ff1e55a6fc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:11.296088 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-15094287-49a4-48ac-9cc5-b5ff1e55a6fc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:11.296858 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-15094287-49a4-48ac-9cc5-b5ff1e55a6fc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:11.297287 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-15094287-49a4-48ac-9cc5-b5ff1e55a6fc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:11.430145 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-15094287-49a4-48ac-9cc5-b5ff1e55a6fc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:11.438659 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-15094287-49a4-48ac-9cc5-b5ff1e55a6fc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:11.440205 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-15094287-49a4-48ac-9cc5-b5ff1e55a6fc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:11.441497 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-15094287-49a4-48ac-9cc5-b5ff1e55a6fc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1808 microversion: 2.20 time: 0.157541 May 26 15:14:11.442054 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 236/508] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:14:11 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:14:12.462959 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-651cfc86-84ef-439b-be2f-ac0af81a651d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:12.463820 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-651cfc86-84ef-439b-be2f-ac0af81a651d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:12.471667 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-651cfc86-84ef-439b-be2f-ac0af81a651d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:12.472111 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-651cfc86-84ef-439b-be2f-ac0af81a651d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:12.472921 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-651cfc86-84ef-439b-be2f-ac0af81a651d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:12.473351 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-651cfc86-84ef-439b-be2f-ac0af81a651d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:12.628722 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-651cfc86-84ef-439b-be2f-ac0af81a651d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:12.638550 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-651cfc86-84ef-439b-be2f-ac0af81a651d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:12.640800 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-651cfc86-84ef-439b-be2f-ac0af81a651d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:12.641994 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-651cfc86-84ef-439b-be2f-ac0af81a651d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1808 microversion: 2.20 time: 0.185992 May 26 15:14:12.642555 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 273/509] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:14:12 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:14:13.522909 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b88a93f2-988b-47e7-b7c0-0d6b717d2cc9 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:14:13.524574 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b88a93f2-988b-47e7-b7c0-0d6b717d2cc9 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:13.531036 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b88a93f2-988b-47e7-b7c0-0d6b717d2cc9 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:13.531525 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b88a93f2-988b-47e7-b7c0-0d6b717d2cc9 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:13.532289 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b88a93f2-988b-47e7-b7c0-0d6b717d2cc9 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:13.532752 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b88a93f2-988b-47e7-b7c0-0d6b717d2cc9 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:13.555898 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.objects.instance [None req-b88a93f2-988b-47e7-b7c0-0d6b717d2cc9 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lazy-loading 'flavor' on Instance uuid b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b {{(pid=117798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:14:13.665861 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-beab2577-602e-4de3-80ae-e317f0672df0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:13.666420 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-beab2577-602e-4de3-80ae-e317f0672df0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:13.673337 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-beab2577-602e-4de3-80ae-e317f0672df0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:13.673856 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-beab2577-602e-4de3-80ae-e317f0672df0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:13.674759 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-beab2577-602e-4de3-80ae-e317f0672df0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:13.675356 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-beab2577-602e-4de3-80ae-e317f0672df0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:13.682198 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b88a93f2-988b-47e7-b7c0-0d6b717d2cc9 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "POST /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b/action" status: 200 len: 32 microversion: 2.1 time: 0.163523 May 26 15:14:13.683151 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 237/510] 10.222.0.45 () {60 vars in 1277 bytes} [Thu May 26 15:14:13 2022] POST /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b/action => generated 32 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 15:14:13.693478 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-cbc87a4a-1c38-46a4-b2c9-1c9d1c8d7d91 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:13.694464 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-cbc87a4a-1c38-46a4-b2c9-1c9d1c8d7d91 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:13.703590 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cbc87a4a-1c38-46a4-b2c9-1c9d1c8d7d91 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:13.704033 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cbc87a4a-1c38-46a4-b2c9-1c9d1c8d7d91 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:13.704809 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cbc87a4a-1c38-46a4-b2c9-1c9d1c8d7d91 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:13.705238 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cbc87a4a-1c38-46a4-b2c9-1c9d1c8d7d91 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:13.910541 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-beab2577-602e-4de3-80ae-e317f0672df0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:13.915430 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-cbc87a4a-1c38-46a4-b2c9-1c9d1c8d7d91 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:13.921294 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-beab2577-602e-4de3-80ae-e317f0672df0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:13.922801 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-beab2577-602e-4de3-80ae-e317f0672df0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:13.923979 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-cbc87a4a-1c38-46a4-b2c9-1c9d1c8d7d91 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1736 microversion: 2.1 time: 0.235571 May 26 15:14:13.924117 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-beab2577-602e-4de3-80ae-e317f0672df0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1808 microversion: 2.20 time: 0.263355 May 26 15:14:13.924565 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 238/511] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:14:13 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1736 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:14:13.931617 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 274/512] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:14:13 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1808 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:14:14.529141 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-ca1f7134-dbce-4589-b8bd-729bae0d7ebe req-cba8372a-e2db-4e16-aeb9-1bd5ff94a281 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6", "name": "network-vif-plugged", "status": "completed", "tag": "6342ec5c-6f4f-42ae-aaeb-2f79c05fef02"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:14:14.538997 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-ca1f7134-dbce-4589-b8bd-729bae0d7ebe req-cba8372a-e2db-4e16-aeb9-1bd5ff94a281 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:14.539492 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-ca1f7134-dbce-4589-b8bd-729bae0d7ebe req-cba8372a-e2db-4e16-aeb9-1bd5ff94a281 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:14.551286 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-ca1f7134-dbce-4589-b8bd-729bae0d7ebe req-cba8372a-e2db-4e16-aeb9-1bd5ff94a281 service nova] Creating event network-vif-plugged:6342ec5c-6f4f-42ae-aaeb-2f79c05fef02 for instance 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 on hv-cinder-84301 May 26 15:14:14.557094 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-ca1f7134-dbce-4589-b8bd-729bae0d7ebe req-cba8372a-e2db-4e16-aeb9-1bd5ff94a281 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031663 May 26 15:14:14.557713 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 239/513] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:14:14.942615 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-d37182c4-d251-4de2-8154-0295af35fa46 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:14.943265 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-d37182c4-d251-4de2-8154-0295af35fa46 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:14.943516 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1aa9e7cc-cdae-478b-8ba5-d47b7fd70fde tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:14.944253 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1aa9e7cc-cdae-478b-8ba5-d47b7fd70fde tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:14.950733 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d37182c4-d251-4de2-8154-0295af35fa46 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:14.951219 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d37182c4-d251-4de2-8154-0295af35fa46 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:14.951442 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1aa9e7cc-cdae-478b-8ba5-d47b7fd70fde tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:14.951904 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1aa9e7cc-cdae-478b-8ba5-d47b7fd70fde tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:14.952019 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d37182c4-d251-4de2-8154-0295af35fa46 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:14.952444 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d37182c4-d251-4de2-8154-0295af35fa46 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:14.952693 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1aa9e7cc-cdae-478b-8ba5-d47b7fd70fde tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:14.953163 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1aa9e7cc-cdae-478b-8ba5-d47b7fd70fde tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:15.188392 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1aa9e7cc-cdae-478b-8ba5-d47b7fd70fde tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:15.196013 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-d37182c4-d251-4de2-8154-0295af35fa46 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:15.198954 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1aa9e7cc-cdae-478b-8ba5-d47b7fd70fde tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:15.200573 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1aa9e7cc-cdae-478b-8ba5-d47b7fd70fde tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:15.201777 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1aa9e7cc-cdae-478b-8ba5-d47b7fd70fde tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1808 microversion: 2.20 time: 0.262600 May 26 15:14:15.202354 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 240/514] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:14:14 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1808 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:14:15.207868 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-d37182c4-d251-4de2-8154-0295af35fa46 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1736 microversion: 2.1 time: 0.270095 May 26 15:14:15.213963 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 275/515] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:14:14 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1736 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:16.221585 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-fe34a86f-218f-4cf1-b0be-2726c01bc3e2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:16.222175 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-fe34a86f-218f-4cf1-b0be-2726c01bc3e2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:16.225203 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-d5d70138-90ec-4cfa-8e01-c68b0d070fb2 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:16.225813 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-d5d70138-90ec-4cfa-8e01-c68b0d070fb2 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:16.228852 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fe34a86f-218f-4cf1-b0be-2726c01bc3e2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:16.229310 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fe34a86f-218f-4cf1-b0be-2726c01bc3e2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:16.230085 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fe34a86f-218f-4cf1-b0be-2726c01bc3e2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:16.230510 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fe34a86f-218f-4cf1-b0be-2726c01bc3e2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:16.232891 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d5d70138-90ec-4cfa-8e01-c68b0d070fb2 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:16.233348 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d5d70138-90ec-4cfa-8e01-c68b0d070fb2 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:16.234114 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d5d70138-90ec-4cfa-8e01-c68b0d070fb2 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:16.234549 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d5d70138-90ec-4cfa-8e01-c68b0d070fb2 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:16.436316 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-fe34a86f-218f-4cf1-b0be-2726c01bc3e2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:16.442885 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-d5d70138-90ec-4cfa-8e01-c68b0d070fb2 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:16.446332 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-fe34a86f-218f-4cf1-b0be-2726c01bc3e2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:16.447903 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-fe34a86f-218f-4cf1-b0be-2726c01bc3e2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:16.449096 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-fe34a86f-218f-4cf1-b0be-2726c01bc3e2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1808 microversion: 2.20 time: 0.231481 May 26 15:14:16.449663 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 241/516] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:14:16 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1808 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:14:16.451753 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-d5d70138-90ec-4cfa-8e01-c68b0d070fb2 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1736 microversion: 2.1 time: 0.230476 May 26 15:14:16.452322 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 276/517] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:14:16 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1736 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:14:17.468269 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-6b819ac5-4753-44e4-bef9-bf3cf3c417d9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:17.468837 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-fa93745d-e4b1-42e9-a180-6550e1e1d9f6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:17.469205 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-6b819ac5-4753-44e4-bef9-bf3cf3c417d9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:17.469309 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-fa93745d-e4b1-42e9-a180-6550e1e1d9f6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:17.476955 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fa93745d-e4b1-42e9-a180-6550e1e1d9f6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:17.477202 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6b819ac5-4753-44e4-bef9-bf3cf3c417d9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:17.477493 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6b819ac5-4753-44e4-bef9-bf3cf3c417d9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:17.477733 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fa93745d-e4b1-42e9-a180-6550e1e1d9f6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:17.478276 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6b819ac5-4753-44e4-bef9-bf3cf3c417d9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:17.478673 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fa93745d-e4b1-42e9-a180-6550e1e1d9f6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:17.478818 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6b819ac5-4753-44e4-bef9-bf3cf3c417d9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:17.479328 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fa93745d-e4b1-42e9-a180-6550e1e1d9f6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:17.693154 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6b819ac5-4753-44e4-bef9-bf3cf3c417d9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:17.697400 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-fa93745d-e4b1-42e9-a180-6550e1e1d9f6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:17.709223 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-fa93745d-e4b1-42e9-a180-6550e1e1d9f6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1736 microversion: 2.1 time: 0.244635 May 26 15:14:17.709809 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 277/518] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:14:17 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1736 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:14:17.710028 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6b819ac5-4753-44e4-bef9-bf3cf3c417d9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:17.712482 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6b819ac5-4753-44e4-bef9-bf3cf3c417d9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:17.713717 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-6b819ac5-4753-44e4-bef9-bf3cf3c417d9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1808 microversion: 2.20 time: 0.249526 May 26 15:14:17.714271 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 242/519] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:14:17 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1808 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:14:18.726562 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-da5a87a4-5ffa-4d69-91e0-18c0782b4d3e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:18.727373 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-da5a87a4-5ffa-4d69-91e0-18c0782b4d3e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:18.732662 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-84822dd9-25b7-4ac5-a69c-45b86540346e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:18.733304 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-84822dd9-25b7-4ac5-a69c-45b86540346e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:18.734062 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-da5a87a4-5ffa-4d69-91e0-18c0782b4d3e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:18.734511 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-da5a87a4-5ffa-4d69-91e0-18c0782b4d3e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:18.735325 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-da5a87a4-5ffa-4d69-91e0-18c0782b4d3e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:18.735765 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-da5a87a4-5ffa-4d69-91e0-18c0782b4d3e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:18.742752 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-84822dd9-25b7-4ac5-a69c-45b86540346e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:18.743237 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-84822dd9-25b7-4ac5-a69c-45b86540346e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:18.744023 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-84822dd9-25b7-4ac5-a69c-45b86540346e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:18.744465 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-84822dd9-25b7-4ac5-a69c-45b86540346e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:18.941180 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-da5a87a4-5ffa-4d69-91e0-18c0782b4d3e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:18.944423 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-84822dd9-25b7-4ac5-a69c-45b86540346e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:18.949969 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-da5a87a4-5ffa-4d69-91e0-18c0782b4d3e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1736 microversion: 2.1 time: 0.227693 May 26 15:14:18.950553 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 278/520] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:14:18 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1736 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:18.953189 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-84822dd9-25b7-4ac5-a69c-45b86540346e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:18.954692 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-84822dd9-25b7-4ac5-a69c-45b86540346e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:18.955919 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-84822dd9-25b7-4ac5-a69c-45b86540346e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1795 microversion: 2.20 time: 0.227190 May 26 15:14:18.956455 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 243/521] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:14:18 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1795 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:14:19.967465 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-81781896-63da-4bd6-8f83-8303541c7488 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:19.967987 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-81781896-63da-4bd6-8f83-8303541c7488 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:19.974398 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-81781896-63da-4bd6-8f83-8303541c7488 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:19.974840 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-81781896-63da-4bd6-8f83-8303541c7488 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:19.975713 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-81781896-63da-4bd6-8f83-8303541c7488 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:19.976750 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-81781896-63da-4bd6-8f83-8303541c7488 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:20.107500 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-81781896-63da-4bd6-8f83-8303541c7488 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:20.115447 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-81781896-63da-4bd6-8f83-8303541c7488 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1736 microversion: 2.1 time: 0.151952 May 26 15:14:20.116015 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 279/522] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:14:19 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:21.134334 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-62d00ba0-a0ad-4f88-929a-1af6a2e44cec tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:21.135102 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-62d00ba0-a0ad-4f88-929a-1af6a2e44cec tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:21.141906 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-62d00ba0-a0ad-4f88-929a-1af6a2e44cec tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:21.142345 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-62d00ba0-a0ad-4f88-929a-1af6a2e44cec tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:21.143156 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-62d00ba0-a0ad-4f88-929a-1af6a2e44cec tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:21.143580 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-62d00ba0-a0ad-4f88-929a-1af6a2e44cec tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:21.273141 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-62d00ba0-a0ad-4f88-929a-1af6a2e44cec tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:21.281192 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-62d00ba0-a0ad-4f88-929a-1af6a2e44cec tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1736 microversion: 2.1 time: 0.151934 May 26 15:14:21.281767 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 244/523] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:14:21 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:22.297898 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-b9376fb5-ef45-4115-88a7-e7c7fad3f042 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:22.298507 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-b9376fb5-ef45-4115-88a7-e7c7fad3f042 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:22.305164 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b9376fb5-ef45-4115-88a7-e7c7fad3f042 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:22.305614 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b9376fb5-ef45-4115-88a7-e7c7fad3f042 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:22.306401 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b9376fb5-ef45-4115-88a7-e7c7fad3f042 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:22.306840 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b9376fb5-ef45-4115-88a7-e7c7fad3f042 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:22.440291 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-b9376fb5-ef45-4115-88a7-e7c7fad3f042 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:22.448818 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-b9376fb5-ef45-4115-88a7-e7c7fad3f042 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1736 microversion: 2.1 time: 0.154864 May 26 15:14:22.449385 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 280/524] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:14:22 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:23.465909 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ee8ddb50-cca7-416d-86a3-5c5738ddcab6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:23.466495 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ee8ddb50-cca7-416d-86a3-5c5738ddcab6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:23.473042 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ee8ddb50-cca7-416d-86a3-5c5738ddcab6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:23.473512 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ee8ddb50-cca7-416d-86a3-5c5738ddcab6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:23.474279 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ee8ddb50-cca7-416d-86a3-5c5738ddcab6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:23.474714 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ee8ddb50-cca7-416d-86a3-5c5738ddcab6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:23.609539 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ee8ddb50-cca7-416d-86a3-5c5738ddcab6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:23.618388 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ee8ddb50-cca7-416d-86a3-5c5738ddcab6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1736 microversion: 2.1 time: 0.156340 May 26 15:14:23.618982 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 245/525] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:14:23 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:24.636583 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-8a0b1693-6d66-4e06-83f4-9b478f9096cd tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:24.637194 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-8a0b1693-6d66-4e06-83f4-9b478f9096cd tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:24.643905 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8a0b1693-6d66-4e06-83f4-9b478f9096cd tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:24.644350 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8a0b1693-6d66-4e06-83f4-9b478f9096cd tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:24.645383 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8a0b1693-6d66-4e06-83f4-9b478f9096cd tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:24.645815 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8a0b1693-6d66-4e06-83f4-9b478f9096cd tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:24.650684 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=100 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:14:24.779978 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-8a0b1693-6d66-4e06-83f4-9b478f9096cd tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:24.788177 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-8a0b1693-6d66-4e06-83f4-9b478f9096cd tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1736 microversion: 2.1 time: 0.155962 May 26 15:14:24.788932 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 281/526] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:14:24 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:25.805884 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c3dc3162-3047-4e66-b2b6-2b87496ec6b6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:25.806537 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c3dc3162-3047-4e66-b2b6-2b87496ec6b6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:25.813197 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c3dc3162-3047-4e66-b2b6-2b87496ec6b6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:25.813641 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c3dc3162-3047-4e66-b2b6-2b87496ec6b6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:25.814406 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c3dc3162-3047-4e66-b2b6-2b87496ec6b6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:25.814834 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c3dc3162-3047-4e66-b2b6-2b87496ec6b6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:26.184955 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c3dc3162-3047-4e66-b2b6-2b87496ec6b6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:26.193129 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c3dc3162-3047-4e66-b2b6-2b87496ec6b6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1736 microversion: 2.1 time: 0.391251 May 26 15:14:26.193710 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 246/527] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:14:25 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1736 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:27.210766 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-5f17d3da-93b0-4f9d-9a96-60f3c983ef31 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:27.211352 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-5f17d3da-93b0-4f9d-9a96-60f3c983ef31 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:27.217571 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5f17d3da-93b0-4f9d-9a96-60f3c983ef31 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:27.218020 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5f17d3da-93b0-4f9d-9a96-60f3c983ef31 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:27.218780 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5f17d3da-93b0-4f9d-9a96-60f3c983ef31 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:27.219245 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5f17d3da-93b0-4f9d-9a96-60f3c983ef31 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:27.347566 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-5f17d3da-93b0-4f9d-9a96-60f3c983ef31 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:27.355741 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-5f17d3da-93b0-4f9d-9a96-60f3c983ef31 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1736 microversion: 2.1 time: 0.148949 May 26 15:14:27.356315 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 282/528] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:14:27 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:28.373348 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e32e85da-1d76-40e4-8df8-2844c65ef38a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:28.373915 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e32e85da-1d76-40e4-8df8-2844c65ef38a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:28.380503 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e32e85da-1d76-40e4-8df8-2844c65ef38a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:28.380951 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e32e85da-1d76-40e4-8df8-2844c65ef38a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:28.381714 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e32e85da-1d76-40e4-8df8-2844c65ef38a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:28.382208 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e32e85da-1d76-40e4-8df8-2844c65ef38a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:28.518203 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e32e85da-1d76-40e4-8df8-2844c65ef38a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:28.521947 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:14:28.529316 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e32e85da-1d76-40e4-8df8-2844c65ef38a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1736 microversion: 2.1 time: 0.159931 May 26 15:14:28.529914 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 247/529] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:14:28 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:29.547389 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-fc68b755-c4a9-4fe8-8636-9d0dfc14922e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:29.548010 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-fc68b755-c4a9-4fe8-8636-9d0dfc14922e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:29.552260 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_api:SELECT=38 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:14:29.556874 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fc68b755-c4a9-4fe8-8636-9d0dfc14922e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:29.557329 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fc68b755-c4a9-4fe8-8636-9d0dfc14922e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:29.558098 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fc68b755-c4a9-4fe8-8636-9d0dfc14922e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:29.558538 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fc68b755-c4a9-4fe8-8636-9d0dfc14922e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:29.687491 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-fc68b755-c4a9-4fe8-8636-9d0dfc14922e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:29.696331 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-fc68b755-c4a9-4fe8-8636-9d0dfc14922e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1736 microversion: 2.1 time: 0.153031 May 26 15:14:29.696916 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 283/530] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:14:29 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:30.714247 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-6671a7f1-52b3-445c-9678-4f5ab5c148f1 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:30.714885 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-6671a7f1-52b3-445c-9678-4f5ab5c148f1 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:30.722552 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6671a7f1-52b3-445c-9678-4f5ab5c148f1 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:30.722997 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6671a7f1-52b3-445c-9678-4f5ab5c148f1 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:30.723849 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6671a7f1-52b3-445c-9678-4f5ab5c148f1 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:30.724280 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6671a7f1-52b3-445c-9678-4f5ab5c148f1 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:30.871428 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6671a7f1-52b3-445c-9678-4f5ab5c148f1 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:30.883565 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-6671a7f1-52b3-445c-9678-4f5ab5c148f1 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1736 microversion: 2.1 time: 0.173705 May 26 15:14:30.884138 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 248/531] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:14:30 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:31.901092 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-ec29ec78-9a3c-48d5-b9fd-60049d3bf6f7 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:31.901693 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-ec29ec78-9a3c-48d5-b9fd-60049d3bf6f7 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:31.908275 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ec29ec78-9a3c-48d5-b9fd-60049d3bf6f7 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:31.908723 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ec29ec78-9a3c-48d5-b9fd-60049d3bf6f7 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:31.909531 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ec29ec78-9a3c-48d5-b9fd-60049d3bf6f7 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:31.909969 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ec29ec78-9a3c-48d5-b9fd-60049d3bf6f7 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:32.044514 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-ec29ec78-9a3c-48d5-b9fd-60049d3bf6f7 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:32.052459 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-ec29ec78-9a3c-48d5-b9fd-60049d3bf6f7 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1736 microversion: 2.1 time: 0.155399 May 26 15:14:32.053016 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 284/532] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:14:31 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:33.069877 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-5b19901d-5490-48ee-8adb-f5194a14850f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:33.070575 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-5b19901d-5490-48ee-8adb-f5194a14850f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:33.077068 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5b19901d-5490-48ee-8adb-f5194a14850f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:33.077509 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5b19901d-5490-48ee-8adb-f5194a14850f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:33.078272 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5b19901d-5490-48ee-8adb-f5194a14850f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:33.078710 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5b19901d-5490-48ee-8adb-f5194a14850f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:33.212096 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-5b19901d-5490-48ee-8adb-f5194a14850f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:33.220080 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-5b19901d-5490-48ee-8adb-f5194a14850f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1736 microversion: 2.1 time: 0.154188 May 26 15:14:33.220649 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 249/533] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:14:33 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:34.237770 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-fee7b6e7-1583-4f03-9614-5853dbb96f5e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:34.238395 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-fee7b6e7-1583-4f03-9614-5853dbb96f5e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:34.246415 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fee7b6e7-1583-4f03-9614-5853dbb96f5e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:34.246836 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fee7b6e7-1583-4f03-9614-5853dbb96f5e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:34.247663 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fee7b6e7-1583-4f03-9614-5853dbb96f5e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:34.248085 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fee7b6e7-1583-4f03-9614-5853dbb96f5e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:34.388463 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-fee7b6e7-1583-4f03-9614-5853dbb96f5e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:34.396887 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-fee7b6e7-1583-4f03-9614-5853dbb96f5e tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1716 microversion: 2.1 time: 0.162940 May 26 15:14:34.397724 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 285/534] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:14:34 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1716 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:34.453279 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-3ad94142-f4c9-4036-bec6-198b3b0f3b14 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:34.453788 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-3ad94142-f4c9-4036-bec6-198b3b0f3b14 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:34.456058 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=33 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:14:34.461447 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3ad94142-f4c9-4036-bec6-198b3b0f3b14 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:34.461886 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3ad94142-f4c9-4036-bec6-198b3b0f3b14 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:34.462649 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3ad94142-f4c9-4036-bec6-198b3b0f3b14 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:34.463079 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3ad94142-f4c9-4036-bec6-198b3b0f3b14 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:34.590231 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-3ad94142-f4c9-4036-bec6-198b3b0f3b14 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] HTTP exception thrown: Cannot 'detach_volume' instance b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b while it is in vm_state rescued May 26 15:14:34.591879 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-3ad94142-f4c9-4036-bec6-198b3b0f3b14 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Request method failure captured: May 26 15:14:34.591879 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: request: DELETE /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b/os-volume_attachments/379451d7-a770-42a0-993a-d1c20a7a8f27 HTTP/1.1 May 26 15:14:34.591879 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept: application/json May 26 15:14:34.591879 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity May 26 15:14:34.591879 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Connection: close May 26 15:14:34.591879 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Length: 0 May 26 15:14:34.591879 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Type: application/json May 26 15:14:34.591879 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Host: 10.222.0.45 May 26 15:14:34.591879 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None May 26 15:14:34.591879 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 May 26 15:14:34.591879 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABij5gMlm5GpsxSW-5gFPLeSCTTSlLXjA9pJg4tHLzyoI_w98hI0aHKaaT7EayS7FvKHWCko4QlLuTbGjrbvwimGwYrU0rK44Sp3IWWOQnjEQh2Is81shN7a9UOyTdxs6LiujiFiQVD-wz53JvK2hkeV3IEn6BZKmbirZ2HujAlq8eqdqQ May 26 15:14:34.591879 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Id: None May 26 15:14:34.591879 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Name: None May 26 15:14:34.591879 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed May 26 15:14:34.591879 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True May 26 15:14:34.591879 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default May 26 15:14:34.591879 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default May 26 15:14:34.591879 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Id: bf95995343d547f78ae88a425f584ac7 May 26 15:14:34.591879 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1170690922 May 26 15:14:34.591879 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Role: reader,member May 26 15:14:34.591879 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Roles: reader,member May 26 15:14:34.593540 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bf95995343d547f78ae88a425f584ac7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bf95995343d547f78ae88a425f584ac7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/bf95995343d547f78ae88a425f584ac7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_bf95995343d547f78ae88a425f584ac7"}]}] May 26 15:14:34.593540 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1170690922 May 26 15:14:34.593540 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Id: bf95995343d547f78ae88a425f584ac7 May 26 15:14:34.593540 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1170690922 May 26 15:14:34.593540 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User: tempest-ServerRescueNegativeTestJSON-1170690922-project May 26 15:14:34.593540 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default May 26 15:14:34.593540 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default May 26 15:14:34.593540 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Id: e29a5217495c41dda9564db96f6e36d1 May 26 15:14:34.593540 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1170690922-project May 26 15:14:34.593540 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: method: > May 26 15:14:34.593540 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: exception: Cannot 'detach_volume' instance b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b while it is in vm_state rescued May 26 15:14:34.594435 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: action_args: {'server_id': 'b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b', 'id': '379451d7-a770-42a0-993a-d1c20a7a8f27'} May 26 15:14:34.594435 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:14:34.594435 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:14:34.594435 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 15:14:34.594435 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 15:14:34.594435 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 15:14:34.594435 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 15:14:34.594435 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 26 15:14:34.594435 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 26 15:14:34.594435 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b in vm_state rescued. Cannot detach_volume while the instance is in this state. May 26 15:14:34.594435 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:14:34.594435 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:14:34.594435 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:14:34.594435 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:14:34.594435 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:14:34.594435 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:14:34.594435 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:14:34.594435 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:14:34.594435 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:14:34.594435 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:14:34.595864 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 26 15:14:34.595864 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 26 15:14:34.595864 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 26 15:14:34.595864 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 26 15:14:34.595864 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b while it is in vm_state rescued May 26 15:14:34.595864 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:14:34.595864 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:14:34.595864 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:14:34.595864 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:14:34.595864 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:14:34.595864 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:14:34.595864 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:14:34.595864 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:14:34.595864 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b while it is in vm_state rescued May 26 15:14:34.595864 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:14:34.595864 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-3ad94142-f4c9-4036-bec6-198b3b0f3b14 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Returning 409 to user: Cannot 'detach_volume' instance b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b while it is in vm_state rescued {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:14:34.597354 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-3ad94142-f4c9-4036-bec6-198b3b0f3b14 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b/os-volume_attachments/379451d7-a770-42a0-993a-d1c20a7a8f27" status: 409 len: 152 microversion: 2.1 time: 0.144075 May 26 15:14:34.597354 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 250/535] 10.222.0.45 () {58 vars in 1415 bytes} [Thu May 26 15:14:34 2022] DELETE /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b/os-volume_attachments/379451d7-a770-42a0-993a-d1c20a7a8f27 => generated 152 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 26 15:14:34.603010 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-0bf2e5b5-2904-4944-b589-c72a7977f077 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:14:34.603686 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-0bf2e5b5-2904-4944-b589-c72a7977f077 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:34.609673 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0bf2e5b5-2904-4944-b589-c72a7977f077 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:34.610116 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0bf2e5b5-2904-4944-b589-c72a7977f077 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:34.610875 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0bf2e5b5-2904-4944-b589-c72a7977f077 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:34.611328 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0bf2e5b5-2904-4944-b589-c72a7977f077 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:34.683015 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-0bf2e5b5-2904-4944-b589-c72a7977f077 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "POST /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b/action" status: 202 len: 0 microversion: 2.1 time: 0.084288 May 26 15:14:34.683847 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 286/536] 10.222.0.45 () {60 vars in 1277 bytes} [Thu May 26 15:14:34 2022] POST /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:14:34.692057 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-737dc791-3541-407e-b335-97f8231968ce tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:34.692947 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-737dc791-3541-407e-b335-97f8231968ce tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:34.700889 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-737dc791-3541-407e-b335-97f8231968ce tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:34.701506 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-737dc791-3541-407e-b335-97f8231968ce tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:34.702103 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-737dc791-3541-407e-b335-97f8231968ce tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:34.702531 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-737dc791-3541-407e-b335-97f8231968ce tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:34.869491 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-737dc791-3541-407e-b335-97f8231968ce tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:34.878054 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-737dc791-3541-407e-b335-97f8231968ce tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1724 microversion: 2.1 time: 0.189811 May 26 15:14:34.878620 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 251/537] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:14:34 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:14:35.898362 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-5f1a6591-c1dd-4a06-9786-ab4f54a9dc9b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:35.899048 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-5f1a6591-c1dd-4a06-9786-ab4f54a9dc9b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:35.905430 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5f1a6591-c1dd-4a06-9786-ab4f54a9dc9b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:35.905870 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5f1a6591-c1dd-4a06-9786-ab4f54a9dc9b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:35.906627 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5f1a6591-c1dd-4a06-9786-ab4f54a9dc9b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:35.907049 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5f1a6591-c1dd-4a06-9786-ab4f54a9dc9b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:36.048076 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-5f1a6591-c1dd-4a06-9786-ab4f54a9dc9b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:36.058345 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-5f1a6591-c1dd-4a06-9786-ab4f54a9dc9b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1724 microversion: 2.1 time: 0.165561 May 26 15:14:36.059038 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 287/538] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:14:35 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:37.076387 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a595d9a9-cb1f-4431-b37b-1eccf58a59ef tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:37.077023 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a595d9a9-cb1f-4431-b37b-1eccf58a59ef tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:37.083665 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a595d9a9-cb1f-4431-b37b-1eccf58a59ef tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:37.084108 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a595d9a9-cb1f-4431-b37b-1eccf58a59ef tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:37.084871 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a595d9a9-cb1f-4431-b37b-1eccf58a59ef tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:37.085294 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a595d9a9-cb1f-4431-b37b-1eccf58a59ef tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:37.220119 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a595d9a9-cb1f-4431-b37b-1eccf58a59ef tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:37.228785 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a595d9a9-cb1f-4431-b37b-1eccf58a59ef tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1724 microversion: 2.1 time: 0.156303 May 26 15:14:37.229362 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 252/539] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:14:37 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:38.247544 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-8a3d52bc-2897-4700-84d0-1d7b4e8b14e9 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:38.248138 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-8a3d52bc-2897-4700-84d0-1d7b4e8b14e9 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:38.254695 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8a3d52bc-2897-4700-84d0-1d7b4e8b14e9 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:38.255170 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8a3d52bc-2897-4700-84d0-1d7b4e8b14e9 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:38.255922 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8a3d52bc-2897-4700-84d0-1d7b4e8b14e9 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:38.256347 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8a3d52bc-2897-4700-84d0-1d7b4e8b14e9 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:38.391311 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-8a3d52bc-2897-4700-84d0-1d7b4e8b14e9 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:38.400978 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-8a3d52bc-2897-4700-84d0-1d7b4e8b14e9 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1724 microversion: 2.1 time: 0.157220 May 26 15:14:38.401551 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 288/540] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:14:38 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:39.418850 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-49094298-8fc3-42bb-9055-c7bb314c15bb tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:39.419671 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-49094298-8fc3-42bb-9055-c7bb314c15bb tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:39.426037 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-49094298-8fc3-42bb-9055-c7bb314c15bb tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:39.426478 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-49094298-8fc3-42bb-9055-c7bb314c15bb tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:39.427279 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-49094298-8fc3-42bb-9055-c7bb314c15bb tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:39.427720 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-49094298-8fc3-42bb-9055-c7bb314c15bb tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:39.572952 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-49094298-8fc3-42bb-9055-c7bb314c15bb tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:39.581107 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-49094298-8fc3-42bb-9055-c7bb314c15bb tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1730 microversion: 2.1 time: 0.166121 May 26 15:14:39.581692 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 253/541] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:14:39 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:39.597585 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-142d0fd0-8fb4-4f93-b037-56f96738c6ea tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:39.598175 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-142d0fd0-8fb4-4f93-b037-56f96738c6ea tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:39.605516 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-142d0fd0-8fb4-4f93-b037-56f96738c6ea tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:39.605864 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-142d0fd0-8fb4-4f93-b037-56f96738c6ea tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:39.606652 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-142d0fd0-8fb4-4f93-b037-56f96738c6ea tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:39.607099 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-142d0fd0-8fb4-4f93-b037-56f96738c6ea tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:39.686566 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-142d0fd0-8fb4-4f93-b037-56f96738c6ea tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092856 May 26 15:14:39.687337 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 289/542] 10.222.0.45 () {58 vars in 1274 bytes} [Thu May 26 15:14:39 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:14:40.720570 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-b94a550f-e584-4196-9dab-34a99f883b40 req-b2fca83c-e9e1-4e33-82a3-46daf4299f1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b", "tag": "cb40c287-1f0d-473f-ac8a-df78c43b1820"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:14:40.731760 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-b94a550f-e584-4196-9dab-34a99f883b40 req-b2fca83c-e9e1-4e33-82a3-46daf4299f1d service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:40.732292 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-b94a550f-e584-4196-9dab-34a99f883b40 req-b2fca83c-e9e1-4e33-82a3-46daf4299f1d service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:40.745996 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-b94a550f-e584-4196-9dab-34a99f883b40 req-b2fca83c-e9e1-4e33-82a3-46daf4299f1d service nova] Creating event network-changed:cb40c287-1f0d-473f-ac8a-df78c43b1820 for instance b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b on hv-cinder-84301 May 26 15:14:40.751447 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-b94a550f-e584-4196-9dab-34a99f883b40 req-b2fca83c-e9e1-4e33-82a3-46daf4299f1d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112250 May 26 15:14:40.752270 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 254/543] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:14:42.769356 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-0fd9ac53-fabc-4a45-a9f7-9f749bee8980 req-b9664a5a-31cf-4261-950f-be770122b820 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b", "tag": "cb40c287-1f0d-473f-ac8a-df78c43b1820"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:14:42.779401 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-0fd9ac53-fabc-4a45-a9f7-9f749bee8980 req-b9664a5a-31cf-4261-950f-be770122b820 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:42.779841 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-0fd9ac53-fabc-4a45-a9f7-9f749bee8980 req-b9664a5a-31cf-4261-950f-be770122b820 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:42.791056 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-0fd9ac53-fabc-4a45-a9f7-9f749bee8980 req-b9664a5a-31cf-4261-950f-be770122b820 service nova] Creating event network-changed:cb40c287-1f0d-473f-ac8a-df78c43b1820 for instance b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b on hv-cinder-84301 May 26 15:14:42.796174 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-0fd9ac53-fabc-4a45-a9f7-9f749bee8980 req-b9664a5a-31cf-4261-950f-be770122b820 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030936 May 26 15:14:42.796787 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 290/544] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:14:44.986005 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-94da8ef7-c23a-49c6-b95d-bc0dff38bc81 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:44.986573 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-94da8ef7-c23a-49c6-b95d-bc0dff38bc81 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:44.993321 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-94da8ef7-c23a-49c6-b95d-bc0dff38bc81 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:44.993831 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-94da8ef7-c23a-49c6-b95d-bc0dff38bc81 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:44.994619 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-94da8ef7-c23a-49c6-b95d-bc0dff38bc81 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:44.995050 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-94da8ef7-c23a-49c6-b95d-bc0dff38bc81 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:45.095452 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.objects.instance [None req-94da8ef7-c23a-49c6-b95d-bc0dff38bc81 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lazy-loading 'services' on Instance uuid 29d9c670-e34a-4363-9e60-745335a3ea6c {{(pid=117798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:14:45.211962 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-94da8ef7-c23a-49c6-b95d-bc0dff38bc81 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "DELETE /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c/os-volume_attachments/4fbad532-0105-44c7-b0c5-843e6003114d" status: 202 len: 0 microversion: 2.1 time: 0.336857 May 26 15:14:45.212560 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 255/545] 10.222.0.45 () {58 vars in 1415 bytes} [Thu May 26 15:14:44 2022] DELETE /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c/os-volume_attachments/4fbad532-0105-44c7-b0c5-843e6003114d => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:14:46.331278 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-cd3cbf8f-2a71-4725-813a-62f3bee57d7b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:14:46.338432 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-cd3cbf8f-2a71-4725-813a-62f3bee57d7b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:46.338906 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-cd3cbf8f-2a71-4725-813a-62f3bee57d7b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:46.361993 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-cd3cbf8f-2a71-4725-813a-62f3bee57d7b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Going to try to stop instance {{(pid=117799) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 26 15:14:46.411049 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-cd3cbf8f-2a71-4725-813a-62f3bee57d7b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "POST /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c/action" status: 202 len: 0 microversion: 2.1 time: 0.084490 May 26 15:14:46.411738 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 291/546] 10.222.0.45 () {60 vars in 1277 bytes} [Thu May 26 15:14:46 2022] POST /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:14:46.421205 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a711a63d-800e-4ed1-97fa-57d993c34fb8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:46.422223 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a711a63d-800e-4ed1-97fa-57d993c34fb8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:46.429103 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a711a63d-800e-4ed1-97fa-57d993c34fb8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:46.429620 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a711a63d-800e-4ed1-97fa-57d993c34fb8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:46.430517 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a711a63d-800e-4ed1-97fa-57d993c34fb8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:46.431006 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a711a63d-800e-4ed1-97fa-57d993c34fb8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:46.572108 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a711a63d-800e-4ed1-97fa-57d993c34fb8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:46.580305 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a711a63d-800e-4ed1-97fa-57d993c34fb8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1677 microversion: 2.1 time: 0.163341 May 26 15:14:46.580896 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 256/547] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:14:46 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:14:47.598701 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-eaadde25-de15-403e-85e2-3ee616902ff3 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:47.599480 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-eaadde25-de15-403e-85e2-3ee616902ff3 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:47.606851 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-eaadde25-de15-403e-85e2-3ee616902ff3 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:47.607331 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-eaadde25-de15-403e-85e2-3ee616902ff3 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:47.608396 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-eaadde25-de15-403e-85e2-3ee616902ff3 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:47.608576 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-eaadde25-de15-403e-85e2-3ee616902ff3 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:47.742872 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-eaadde25-de15-403e-85e2-3ee616902ff3 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:47.750561 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-eaadde25-de15-403e-85e2-3ee616902ff3 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1677 microversion: 2.1 time: 0.156454 May 26 15:14:47.751154 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 292/548] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:14:47 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:48.773481 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f504528a-6e53-440e-b4ca-7e96fc830deb tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:48.774328 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f504528a-6e53-440e-b4ca-7e96fc830deb tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:48.782665 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f504528a-6e53-440e-b4ca-7e96fc830deb tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:48.783354 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f504528a-6e53-440e-b4ca-7e96fc830deb tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:48.784394 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f504528a-6e53-440e-b4ca-7e96fc830deb tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:48.784836 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f504528a-6e53-440e-b4ca-7e96fc830deb tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:48.930235 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f504528a-6e53-440e-b4ca-7e96fc830deb tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:48.937910 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f504528a-6e53-440e-b4ca-7e96fc830deb tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1677 microversion: 2.1 time: 0.170596 May 26 15:14:48.938426 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 257/549] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:14:48 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:49.956944 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-f2d38ecc-db58-4359-ab29-b319499f99fa tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:49.957598 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-f2d38ecc-db58-4359-ab29-b319499f99fa tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:49.964202 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f2d38ecc-db58-4359-ab29-b319499f99fa tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:49.964675 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f2d38ecc-db58-4359-ab29-b319499f99fa tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:49.965491 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f2d38ecc-db58-4359-ab29-b319499f99fa tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:49.965873 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f2d38ecc-db58-4359-ab29-b319499f99fa tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:50.103812 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-f2d38ecc-db58-4359-ab29-b319499f99fa tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:50.113992 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-f2d38ecc-db58-4359-ab29-b319499f99fa tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1677 microversion: 2.1 time: 0.160865 May 26 15:14:50.114571 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 293/550] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:14:49 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:51.132992 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a0c56e2c-7cd8-4a45-aeaf-9ffca8a87089 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:51.133627 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a0c56e2c-7cd8-4a45-aeaf-9ffca8a87089 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:51.140372 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a0c56e2c-7cd8-4a45-aeaf-9ffca8a87089 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:51.140822 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a0c56e2c-7cd8-4a45-aeaf-9ffca8a87089 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:51.141590 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a0c56e2c-7cd8-4a45-aeaf-9ffca8a87089 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:51.142023 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a0c56e2c-7cd8-4a45-aeaf-9ffca8a87089 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:51.285801 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a0c56e2c-7cd8-4a45-aeaf-9ffca8a87089 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:51.295703 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a0c56e2c-7cd8-4a45-aeaf-9ffca8a87089 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1677 microversion: 2.1 time: 0.167825 May 26 15:14:51.296359 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 258/551] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:14:51 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:52.314868 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-3b881184-9d71-48aa-ad09-e17cb7e177f6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:52.315511 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-3b881184-9d71-48aa-ad09-e17cb7e177f6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:52.322382 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-3b881184-9d71-48aa-ad09-e17cb7e177f6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:52.322824 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-3b881184-9d71-48aa-ad09-e17cb7e177f6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:52.323618 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-3b881184-9d71-48aa-ad09-e17cb7e177f6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:52.324046 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-3b881184-9d71-48aa-ad09-e17cb7e177f6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:52.464240 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-3b881184-9d71-48aa-ad09-e17cb7e177f6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:52.472048 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-3b881184-9d71-48aa-ad09-e17cb7e177f6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1677 microversion: 2.1 time: 0.161052 May 26 15:14:52.472616 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 294/552] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:14:52 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:53.489608 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-0045bce1-43b9-48b4-8a4e-2d84c2d8718b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:53.490270 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-0045bce1-43b9-48b4-8a4e-2d84c2d8718b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:53.497329 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0045bce1-43b9-48b4-8a4e-2d84c2d8718b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:53.497640 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0045bce1-43b9-48b4-8a4e-2d84c2d8718b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:53.498439 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0045bce1-43b9-48b4-8a4e-2d84c2d8718b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:53.498876 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0045bce1-43b9-48b4-8a4e-2d84c2d8718b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:53.633967 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-0045bce1-43b9-48b4-8a4e-2d84c2d8718b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:53.641578 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-0045bce1-43b9-48b4-8a4e-2d84c2d8718b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1677 microversion: 2.1 time: 0.156169 May 26 15:14:53.642146 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 259/553] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:14:53 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:54.659852 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-ef7bb898-b51a-446c-a6af-6006e29f01e8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:54.660642 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-ef7bb898-b51a-446c-a6af-6006e29f01e8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:54.667875 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ef7bb898-b51a-446c-a6af-6006e29f01e8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:54.668323 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ef7bb898-b51a-446c-a6af-6006e29f01e8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:54.669091 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ef7bb898-b51a-446c-a6af-6006e29f01e8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:54.669525 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ef7bb898-b51a-446c-a6af-6006e29f01e8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:54.672428 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:14:54.829378 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-ef7bb898-b51a-446c-a6af-6006e29f01e8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:54.837515 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-ef7bb898-b51a-446c-a6af-6006e29f01e8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1677 microversion: 2.1 time: 0.181530 May 26 15:14:54.838166 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 295/554] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:14:54 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1677 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:55.855403 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-53ec2163-42f6-4eed-95af-bc4a6ae37339 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:55.856005 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-53ec2163-42f6-4eed-95af-bc4a6ae37339 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:55.862687 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-53ec2163-42f6-4eed-95af-bc4a6ae37339 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:55.863160 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-53ec2163-42f6-4eed-95af-bc4a6ae37339 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:55.863983 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-53ec2163-42f6-4eed-95af-bc4a6ae37339 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:55.864421 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-53ec2163-42f6-4eed-95af-bc4a6ae37339 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:56.003997 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-53ec2163-42f6-4eed-95af-bc4a6ae37339 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:56.011961 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-53ec2163-42f6-4eed-95af-bc4a6ae37339 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1677 microversion: 2.1 time: 0.160523 May 26 15:14:56.012543 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 260/555] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:14:55 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:57.035763 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-7200bb00-7ae3-419a-bb95-04320addeed7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:57.039328 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-7200bb00-7ae3-419a-bb95-04320addeed7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:57.046432 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7200bb00-7ae3-419a-bb95-04320addeed7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:57.047581 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7200bb00-7ae3-419a-bb95-04320addeed7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:57.047581 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7200bb00-7ae3-419a-bb95-04320addeed7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:57.047969 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7200bb00-7ae3-419a-bb95-04320addeed7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:57.204100 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-7200bb00-7ae3-419a-bb95-04320addeed7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:57.212355 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-7200bb00-7ae3-419a-bb95-04320addeed7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1677 microversion: 2.1 time: 0.186234 May 26 15:14:57.212938 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 296/556] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:14:57 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1677 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:58.229864 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-895dfb45-62a4-4314-a915-d35ad3583a77 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:58.230597 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-895dfb45-62a4-4314-a915-d35ad3583a77 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:58.237089 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-895dfb45-62a4-4314-a915-d35ad3583a77 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:58.237536 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-895dfb45-62a4-4314-a915-d35ad3583a77 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:58.238293 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-895dfb45-62a4-4314-a915-d35ad3583a77 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:58.238721 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-895dfb45-62a4-4314-a915-d35ad3583a77 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:58.379525 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-895dfb45-62a4-4314-a915-d35ad3583a77 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:58.392184 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-895dfb45-62a4-4314-a915-d35ad3583a77 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1677 microversion: 2.1 time: 0.165812 May 26 15:14:58.393212 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 261/557] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:14:58 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:59.411347 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-4af18e9c-0a37-4a14-adbc-cc9ad1be7ea7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:59.411952 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-4af18e9c-0a37-4a14-adbc-cc9ad1be7ea7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:59.420356 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4af18e9c-0a37-4a14-adbc-cc9ad1be7ea7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:59.420792 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4af18e9c-0a37-4a14-adbc-cc9ad1be7ea7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:59.421578 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4af18e9c-0a37-4a14-adbc-cc9ad1be7ea7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:59.422002 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4af18e9c-0a37-4a14-adbc-cc9ad1be7ea7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:59.559232 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-4af18e9c-0a37-4a14-adbc-cc9ad1be7ea7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:59.566806 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-4af18e9c-0a37-4a14-adbc-cc9ad1be7ea7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1677 microversion: 2.1 time: 0.159327 May 26 15:14:59.567415 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 297/558] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:14:59 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:00.584207 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-cacd652b-42a0-463a-8007-6068534da562 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:00.584892 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-cacd652b-42a0-463a-8007-6068534da562 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:00.592527 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cacd652b-42a0-463a-8007-6068534da562 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:00.593150 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cacd652b-42a0-463a-8007-6068534da562 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:00.593929 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cacd652b-42a0-463a-8007-6068534da562 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:00.594369 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cacd652b-42a0-463a-8007-6068534da562 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:00.735007 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-cacd652b-42a0-463a-8007-6068534da562 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:00.737405 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:15:00.744760 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-cacd652b-42a0-463a-8007-6068534da562 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1677 microversion: 2.1 time: 0.164480 May 26 15:15:00.745746 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 262/559] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:00 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:01.768593 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-9051de6f-84ae-445d-8fb6-99733f38f092 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:01.769561 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-9051de6f-84ae-445d-8fb6-99733f38f092 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:01.773288 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_api:SELECT=30 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:15:01.780998 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9051de6f-84ae-445d-8fb6-99733f38f092 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:01.781449 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9051de6f-84ae-445d-8fb6-99733f38f092 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:01.782290 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9051de6f-84ae-445d-8fb6-99733f38f092 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:01.782679 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9051de6f-84ae-445d-8fb6-99733f38f092 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:01.930575 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-9051de6f-84ae-445d-8fb6-99733f38f092 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:01.938745 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-9051de6f-84ae-445d-8fb6-99733f38f092 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1654 microversion: 2.1 time: 0.174513 May 26 15:15:01.939334 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 298/560] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:01 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1654 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:01.956093 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-7d4eb0ae-fd1e-44d0-9282-3c2fe4e724c6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:15:01.964216 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7d4eb0ae-fd1e-44d0-9282-3c2fe4e724c6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:01.964657 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7d4eb0ae-fd1e-44d0-9282-3c2fe4e724c6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:01.988718 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-7d4eb0ae-fd1e-44d0-9282-3c2fe4e724c6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Going to try to start instance {{(pid=117798) start /opt/stack/nova/nova/compute/api.py:2730}} May 26 15:15:02.039532 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-7d4eb0ae-fd1e-44d0-9282-3c2fe4e724c6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "POST /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c/action" status: 202 len: 0 microversion: 2.1 time: 0.087244 May 26 15:15:02.040100 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 263/561] 10.222.0.45 () {60 vars in 1277 bytes} [Thu May 26 15:15:01 2022] POST /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 15:15:02.048405 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-834ca12c-f5c5-400c-92ed-b643b9348861 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:02.049021 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-834ca12c-f5c5-400c-92ed-b643b9348861 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:02.055827 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-834ca12c-f5c5-400c-92ed-b643b9348861 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:02.056315 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-834ca12c-f5c5-400c-92ed-b643b9348861 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:02.057199 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-834ca12c-f5c5-400c-92ed-b643b9348861 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:02.057683 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-834ca12c-f5c5-400c-92ed-b643b9348861 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:02.210257 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-834ca12c-f5c5-400c-92ed-b643b9348861 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:02.219874 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-834ca12c-f5c5-400c-92ed-b643b9348861 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1663 microversion: 2.1 time: 0.175233 May 26 15:15:02.220454 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 299/562] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:02 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1663 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:03.241538 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a4a0a705-0390-48d0-939b-59859ce78b5f tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:03.242247 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a4a0a705-0390-48d0-939b-59859ce78b5f tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:03.248792 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a4a0a705-0390-48d0-939b-59859ce78b5f tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:03.249228 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a4a0a705-0390-48d0-939b-59859ce78b5f tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:03.249991 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a4a0a705-0390-48d0-939b-59859ce78b5f tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:03.250413 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a4a0a705-0390-48d0-939b-59859ce78b5f tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:03.396257 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a4a0a705-0390-48d0-939b-59859ce78b5f tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:03.404736 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a4a0a705-0390-48d0-939b-59859ce78b5f tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1663 microversion: 2.1 time: 0.169563 May 26 15:15:03.405317 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 264/563] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:03 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1663 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:04.424235 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-2b9cb67c-4414-4795-b2d4-694ae32e2163 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:04.424814 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-2b9cb67c-4414-4795-b2d4-694ae32e2163 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:04.432022 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2b9cb67c-4414-4795-b2d4-694ae32e2163 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:04.432474 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2b9cb67c-4414-4795-b2d4-694ae32e2163 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:04.433247 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2b9cb67c-4414-4795-b2d4-694ae32e2163 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:04.433684 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2b9cb67c-4414-4795-b2d4-694ae32e2163 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:04.578516 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-2b9cb67c-4414-4795-b2d4-694ae32e2163 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:04.586278 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-2b9cb67c-4414-4795-b2d4-694ae32e2163 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1667 microversion: 2.1 time: 0.165983 May 26 15:15:04.586852 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 300/564] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:04 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1667 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:11.394664 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c3d4df2b-94e7-42b5-ba5b-58fd872bc657 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:11.395234 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c3d4df2b-94e7-42b5-ba5b-58fd872bc657 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 966278e6-017a-4267-a3b1-98edbcde5e16] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:11.397860 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=30 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:15:11.404505 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c3d4df2b-94e7-42b5-ba5b-58fd872bc657 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:11.404959 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c3d4df2b-94e7-42b5-ba5b-58fd872bc657 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:11.405722 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c3d4df2b-94e7-42b5-ba5b-58fd872bc657 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:11.406159 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c3d4df2b-94e7-42b5-ba5b-58fd872bc657 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:11.430675 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c3d4df2b-94e7-42b5-ba5b-58fd872bc657 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16/ips" status: 200 len: 149 microversion: 2.1 time: 0.095650 May 26 15:15:11.431268 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 265/565] 10.222.0.45 () {58 vars in 1247 bytes} [Thu May 26 15:15:11 2022] GET /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16/ips => generated 149 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:15:11.442382 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-3eca5e25-9a17-4c89-99ad-c389e226b3c3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9be0290-06e5-4b28-9b95-02483743f240"}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:15:11.444056 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-3eca5e25-9a17-4c89-99ad-c389e226b3c3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 966278e6-017a-4267-a3b1-98edbcde5e16] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:11.450511 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-3eca5e25-9a17-4c89-99ad-c389e226b3c3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:11.450952 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-3eca5e25-9a17-4c89-99ad-c389e226b3c3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:11.451749 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-3eca5e25-9a17-4c89-99ad-c389e226b3c3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:11.453565 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-3eca5e25-9a17-4c89-99ad-c389e226b3c3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:11.538903 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.wsgi [None req-3eca5e25-9a17-4c89-99ad-c389e226b3c3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] HTTP exception thrown: Invalid volume: volume f9be0290-06e5-4b28-9b95-02483743f240 is already attached to instances: f969f1fa-bb13-4b63-9095-0881db5202df May 26 15:15:11.540697 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-3eca5e25-9a17-4c89-99ad-c389e226b3c3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Request method failure captured: May 26 15:15:11.540697 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: request: POST /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16/os-volume_attachments HTTP/1.1 May 26 15:15:11.540697 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept: application/json May 26 15:15:11.540697 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept-Encoding: identity May 26 15:15:11.540697 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Connection: close May 26 15:15:11.540697 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Length: 74 May 26 15:15:11.540697 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Type: application/json May 26 15:15:11.540697 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Host: 10.222.0.45 May 26 15:15:11.540697 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Openstack-System-Scope: None May 26 15:15:11.540697 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: User-Agent: python-urllib3/1.26.9 May 26 15:15:11.540697 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Auth-Token: gAAAAABij5gKsz5qj5DNdZrMFjr-Jr5xg2mNFFRPkTRxdAGsu10bP3EnBAcmrx6BKDNDgfsXd480T_XTCyywquChHsMxkBXmsyJsxmtyqnYAiCUvnNXzq6C4KvbHPcEIVG_Dh3vBN1K_0JPHyQtkc2u3wwrrdDbhsPbSJJLP4Pdm3CUM8QN6AT4 May 26 15:15:11.540697 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Id: None May 26 15:15:11.540697 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Name: None May 26 15:15:11.540697 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Identity-Status: Confirmed May 26 15:15:11.540697 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Is-Admin-Project: True May 26 15:15:11.540697 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Id: default May 26 15:15:11.540697 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Name: Default May 26 15:15:11.540697 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Id: 196700c560cd4d6e9461ec9571facf39 May 26 15:15:11.540697 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Name: tempest-AttachVolumeNegativeTest-1949965076 May 26 15:15:11.540697 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Role: reader,member May 26 15:15:11.540697 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Roles: reader,member May 26 15:15:11.542233 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/196700c560cd4d6e9461ec9571facf39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/196700c560cd4d6e9461ec9571facf39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/196700c560cd4d6e9461ec9571facf39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_196700c560cd4d6e9461ec9571facf39"}]}] May 26 15:15:11.542233 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant: tempest-AttachVolumeNegativeTest-1949965076 May 26 15:15:11.542233 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Id: 196700c560cd4d6e9461ec9571facf39 May 26 15:15:11.542233 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1949965076 May 26 15:15:11.542233 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User: tempest-AttachVolumeNegativeTest-1949965076-project May 26 15:15:11.542233 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Id: default May 26 15:15:11.542233 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Name: Default May 26 15:15:11.542233 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Id: 1421fb674ae04d6ea9ae342b73ce8115 May 26 15:15:11.542233 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Name: tempest-AttachVolumeNegativeTest-1949965076-project May 26 15:15:11.542233 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: May 26 15:15:11.542233 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: {"volumeAttachment": {"volumeId": "f9be0290-06e5-4b28-9b95-02483743f240"}} May 26 15:15:11.542233 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: method: > May 26 15:15:11.543102 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: exception: Invalid volume: volume f9be0290-06e5-4b28-9b95-02483743f240 is already attached to instances: f969f1fa-bb13-4b63-9095-0881db5202df May 26 15:15:11.543102 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: action_args: {'server_id': '966278e6-017a-4267-a3b1-98edbcde5e16', 'body': {'volumeAttachment': {'volumeId': 'f9be0290-06e5-4b28-9b95-02483743f240'}}} May 26 15:15:11.543102 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:15:11.543102 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:11.543102 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 15:15:11.543102 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 15:15:11.543102 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 15:15:11.543102 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 15:15:11.543102 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 15:15:11.543102 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 15:15:11.543102 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 26 15:15:11.543102 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 26 15:15:11.543102 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 26 15:15:11.543102 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 26 15:15:11.543102 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f9be0290-06e5-4b28-9b95-02483743f240 is already attached to instances: f969f1fa-bb13-4b63-9095-0881db5202df May 26 15:15:11.543102 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:15:11.543102 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:15:11.543102 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:15:11.543102 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:11.544297 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:15:11.544297 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:15:11.544297 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:15:11.544297 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:15:11.544297 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:15:11.544297 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:15:11.544297 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 15:15:11.544297 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 15:15:11.544297 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 15:15:11.544297 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 15:15:11.544297 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 15:15:11.544297 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 15:15:11.544297 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 26 15:15:11.544297 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 15:15:11.544297 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f9be0290-06e5-4b28-9b95-02483743f240 is already attached to instances: f969f1fa-bb13-4b63-9095-0881db5202df May 26 15:15:11.544297 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:15:11.544297 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:15:11.544297 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:15:11.544297 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:11.544297 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:15:11.545722 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:15:11.545722 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:15:11.545722 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:15:11.545722 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f9be0290-06e5-4b28-9b95-02483743f240 is already attached to instances: f969f1fa-bb13-4b63-9095-0881db5202df May 26 15:15:11.545722 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:15:11.545722 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-3eca5e25-9a17-4c89-99ad-c389e226b3c3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Returning 400 to user: Invalid volume: volume f9be0290-06e5-4b28-9b95-02483743f240 is already attached to instances: f969f1fa-bb13-4b63-9095-0881db5202df {{(pid=117799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:15:11.545722 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-3eca5e25-9a17-4c89-99ad-c389e226b3c3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "POST /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104268 May 26 15:15:11.546739 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 301/566] 10.222.0.45 () {60 vars in 1322 bytes} [Thu May 26 15:15:11 2022] POST /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 15:15:11.551699 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-dfff2de7-16bc-4b10-b617-a66700c41d6e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:11.552190 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-dfff2de7-16bc-4b10-b617-a66700c41d6e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 966278e6-017a-4267-a3b1-98edbcde5e16] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:11.559062 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dfff2de7-16bc-4b10-b617-a66700c41d6e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:11.560275 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dfff2de7-16bc-4b10-b617-a66700c41d6e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:11.561988 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dfff2de7-16bc-4b10-b617-a66700c41d6e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:11.562419 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dfff2de7-16bc-4b10-b617-a66700c41d6e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:11.588294 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-dfff2de7-16bc-4b10-b617-a66700c41d6e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 966278e6-017a-4267-a3b1-98edbcde5e16] Going to try to terminate instance {{(pid=117798) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:15:11.686345 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-dfff2de7-16bc-4b10-b617-a66700c41d6e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "DELETE /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16" status: 204 len: 0 microversion: 2.1 time: 0.137841 May 26 15:15:11.687075 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 266/567] 10.222.0.45 () {58 vars in 1238 bytes} [Thu May 26 15:15:11 2022] DELETE /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:15:11.696010 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-893c43d6-ad4f-4346-9498-d15090157ff0 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:11.696620 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-893c43d6-ad4f-4346-9498-d15090157ff0 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 966278e6-017a-4267-a3b1-98edbcde5e16] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:11.703468 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-893c43d6-ad4f-4346-9498-d15090157ff0 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:11.703918 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-893c43d6-ad4f-4346-9498-d15090157ff0 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:11.704692 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-893c43d6-ad4f-4346-9498-d15090157ff0 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:11.705128 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-893c43d6-ad4f-4346-9498-d15090157ff0 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:11.842525 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-893c43d6-ad4f-4346-9498-d15090157ff0 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:11.850952 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-893c43d6-ad4f-4346-9498-d15090157ff0 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16" status: 200 len: 1680 microversion: 2.1 time: 0.159398 May 26 15:15:11.851524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 302/568] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:11 2022] GET /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:12.870292 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d09d9b3c-2577-46c1-9751-b2fa9ce2b7a8 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:12.870972 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-d09d9b3c-2577-46c1-9751-b2fa9ce2b7a8 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 966278e6-017a-4267-a3b1-98edbcde5e16] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:12.876936 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d09d9b3c-2577-46c1-9751-b2fa9ce2b7a8 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:12.877377 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d09d9b3c-2577-46c1-9751-b2fa9ce2b7a8 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:12.878122 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d09d9b3c-2577-46c1-9751-b2fa9ce2b7a8 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:12.878550 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d09d9b3c-2577-46c1-9751-b2fa9ce2b7a8 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:13.013463 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d09d9b3c-2577-46c1-9751-b2fa9ce2b7a8 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:13.023241 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-d09d9b3c-2577-46c1-9751-b2fa9ce2b7a8 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16" status: 200 len: 1680 microversion: 2.1 time: 0.158387 May 26 15:15:13.023822 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 267/569] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:12 2022] GET /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:13.998270 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-2aab47b0-a880-48ce-997e-722dcad3f3e4 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:15:13.998856 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-2aab47b0-a880-48ce-997e-722dcad3f3e4 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:14.005598 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2aab47b0-a880-48ce-997e-722dcad3f3e4 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:14.006149 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2aab47b0-a880-48ce-997e-722dcad3f3e4 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:14.006903 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2aab47b0-a880-48ce-997e-722dcad3f3e4 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:14.007351 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2aab47b0-a880-48ce-997e-722dcad3f3e4 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:14.034850 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.objects.instance [None req-2aab47b0-a880-48ce-997e-722dcad3f3e4 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lazy-loading 'flavor' on Instance uuid 4e1f09bd-1e01-460e-be13-9b1749b27926 {{(pid=117799) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:15:14.041149 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-4f69f806-0c9e-4877-9cb0-53b930af09d1 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:14.042980 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-4f69f806-0c9e-4877-9cb0-53b930af09d1 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 966278e6-017a-4267-a3b1-98edbcde5e16] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:14.049687 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4f69f806-0c9e-4877-9cb0-53b930af09d1 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:14.050128 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4f69f806-0c9e-4877-9cb0-53b930af09d1 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:14.051101 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4f69f806-0c9e-4877-9cb0-53b930af09d1 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:14.051532 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4f69f806-0c9e-4877-9cb0-53b930af09d1 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:14.137105 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-2aab47b0-a880-48ce-997e-722dcad3f3e4 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "POST /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926/action" status: 202 len: 0 microversion: 2.1 time: 0.142565 May 26 15:15:14.137885 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 303/570] 10.222.0.45 () {60 vars in 1277 bytes} [Thu May 26 15:15:13 2022] POST /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:15:14.151937 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-fe50f6e6-206f-48b9-bcc8-b36e68685253 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:14.152656 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-fe50f6e6-206f-48b9-bcc8-b36e68685253 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:14.160188 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fe50f6e6-206f-48b9-bcc8-b36e68685253 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:14.163443 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fe50f6e6-206f-48b9-bcc8-b36e68685253 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:14.164931 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fe50f6e6-206f-48b9-bcc8-b36e68685253 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:14.165574 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fe50f6e6-206f-48b9-bcc8-b36e68685253 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:14.201049 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-4f69f806-0c9e-4877-9cb0-53b930af09d1 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:14.210534 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-4f69f806-0c9e-4877-9cb0-53b930af09d1 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16" status: 200 len: 1680 microversion: 2.1 time: 0.174267 May 26 15:15:14.221794 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 268/571] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:14 2022] GET /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16 => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:15:14.329762 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-fe50f6e6-206f-48b9-bcc8-b36e68685253 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:14.338413 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-fe50f6e6-206f-48b9-bcc8-b36e68685253 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1567 microversion: 2.1 time: 0.194997 May 26 15:15:14.339004 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 304/572] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:14 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1567 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:14.775763 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-0f135782-3acb-452f-a9d3-54d23bb4e123 req-38f35e98-ac6e-45db-9c09-f20bea4ac9b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "966278e6-017a-4267-a3b1-98edbcde5e16", "name": "network-vif-deleted", "tag": "dea2970b-0e07-4876-9293-c6e42ddeeac1"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:15:14.794912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-0f135782-3acb-452f-a9d3-54d23bb4e123 req-38f35e98-ac6e-45db-9c09-f20bea4ac9b6 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:14.795765 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-0f135782-3acb-452f-a9d3-54d23bb4e123 req-38f35e98-ac6e-45db-9c09-f20bea4ac9b6 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:14.812586 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-0f135782-3acb-452f-a9d3-54d23bb4e123 req-38f35e98-ac6e-45db-9c09-f20bea4ac9b6 service nova] Creating event network-vif-deleted:dea2970b-0e07-4876-9293-c6e42ddeeac1 for instance 966278e6-017a-4267-a3b1-98edbcde5e16 on hv-cinder-84301 May 26 15:15:14.818754 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-0f135782-3acb-452f-a9d3-54d23bb4e123 req-38f35e98-ac6e-45db-9c09-f20bea4ac9b6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121220 May 26 15:15:14.819729 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 269/573] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:15:15.230557 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-70f4dc7b-986f-4c86-a161-4a256fa0671d tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:15.231458 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-70f4dc7b-986f-4c86-a161-4a256fa0671d tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 966278e6-017a-4267-a3b1-98edbcde5e16] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:15.238844 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-70f4dc7b-986f-4c86-a161-4a256fa0671d tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:15.239849 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-70f4dc7b-986f-4c86-a161-4a256fa0671d tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:15.241725 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-70f4dc7b-986f-4c86-a161-4a256fa0671d tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:15.242386 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-70f4dc7b-986f-4c86-a161-4a256fa0671d tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:15.285623 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-70f4dc7b-986f-4c86-a161-4a256fa0671d tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:15.288328 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-70f4dc7b-986f-4c86-a161-4a256fa0671d tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:15.288817 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.objects.instance [None req-70f4dc7b-986f-4c86-a161-4a256fa0671d tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lazy-loading 'fault' on Instance uuid 966278e6-017a-4267-a3b1-98edbcde5e16 {{(pid=117799) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:15:15.347848 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-70f4dc7b-986f-4c86-a161-4a256fa0671d tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:15.357922 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b3bb9b7e-9292-49fc-b3c3-192becf523a5 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:15.358621 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b3bb9b7e-9292-49fc-b3c3-192becf523a5 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:15.369526 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-70f4dc7b-986f-4c86-a161-4a256fa0671d tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16" status: 200 len: 1331 microversion: 2.1 time: 0.143156 May 26 15:15:15.383174 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 305/574] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:15 2022] GET /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16 => generated 1331 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:15:15.384814 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b3bb9b7e-9292-49fc-b3c3-192becf523a5 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:15.385535 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b3bb9b7e-9292-49fc-b3c3-192becf523a5 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:15.386570 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b3bb9b7e-9292-49fc-b3c3-192becf523a5 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:15.387542 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b3bb9b7e-9292-49fc-b3c3-192becf523a5 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:15.550771 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b3bb9b7e-9292-49fc-b3c3-192becf523a5 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:15.558965 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b3bb9b7e-9292-49fc-b3c3-192becf523a5 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1567 microversion: 2.1 time: 0.206585 May 26 15:15:15.559632 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 270/575] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:15 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1567 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:15:16.394656 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-ca8215af-3310-4bc7-8593-f2bfd3450bc5 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:16.395637 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-ca8215af-3310-4bc7-8593-f2bfd3450bc5 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 966278e6-017a-4267-a3b1-98edbcde5e16] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:16.402411 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ca8215af-3310-4bc7-8593-f2bfd3450bc5 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:16.402965 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ca8215af-3310-4bc7-8593-f2bfd3450bc5 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:16.403786 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ca8215af-3310-4bc7-8593-f2bfd3450bc5 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:16.404226 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ca8215af-3310-4bc7-8593-f2bfd3450bc5 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:16.419266 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.wsgi [None req-ca8215af-3310-4bc7-8593-f2bfd3450bc5 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] HTTP exception thrown: Instance 966278e6-017a-4267-a3b1-98edbcde5e16 could not be found. May 26 15:15:16.421186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-ca8215af-3310-4bc7-8593-f2bfd3450bc5 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Request method failure captured: May 26 15:15:16.421186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: request: GET /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16 HTTP/1.1 May 26 15:15:16.421186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept: application/json May 26 15:15:16.421186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept-Encoding: identity May 26 15:15:16.421186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Connection: close May 26 15:15:16.421186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Length: 0 May 26 15:15:16.421186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Type: application/json May 26 15:15:16.421186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Host: 10.222.0.45 May 26 15:15:16.421186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Openstack-System-Scope: None May 26 15:15:16.421186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: User-Agent: python-urllib3/1.26.9 May 26 15:15:16.421186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Auth-Token: gAAAAABij5gKsz5qj5DNdZrMFjr-Jr5xg2mNFFRPkTRxdAGsu10bP3EnBAcmrx6BKDNDgfsXd480T_XTCyywquChHsMxkBXmsyJsxmtyqnYAiCUvnNXzq6C4KvbHPcEIVG_Dh3vBN1K_0JPHyQtkc2u3wwrrdDbhsPbSJJLP4Pdm3CUM8QN6AT4 May 26 15:15:16.421186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Id: None May 26 15:15:16.421186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Name: None May 26 15:15:16.421186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Identity-Status: Confirmed May 26 15:15:16.421186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Is-Admin-Project: True May 26 15:15:16.421186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Id: default May 26 15:15:16.421186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Name: Default May 26 15:15:16.421186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Id: 196700c560cd4d6e9461ec9571facf39 May 26 15:15:16.421186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Name: tempest-AttachVolumeNegativeTest-1949965076 May 26 15:15:16.421186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Role: reader,member May 26 15:15:16.421186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Roles: reader,member May 26 15:15:16.422507 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/196700c560cd4d6e9461ec9571facf39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/196700c560cd4d6e9461ec9571facf39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/196700c560cd4d6e9461ec9571facf39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_196700c560cd4d6e9461ec9571facf39"}]}] May 26 15:15:16.422507 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant: tempest-AttachVolumeNegativeTest-1949965076 May 26 15:15:16.422507 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Id: 196700c560cd4d6e9461ec9571facf39 May 26 15:15:16.422507 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1949965076 May 26 15:15:16.422507 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User: tempest-AttachVolumeNegativeTest-1949965076-project May 26 15:15:16.422507 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Id: default May 26 15:15:16.422507 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Name: Default May 26 15:15:16.422507 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Id: 1421fb674ae04d6ea9ae342b73ce8115 May 26 15:15:16.422507 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Name: tempest-AttachVolumeNegativeTest-1949965076-project May 26 15:15:16.422507 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: method: > May 26 15:15:16.422507 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: exception: Instance 966278e6-017a-4267-a3b1-98edbcde5e16 could not be found. May 26 15:15:16.422507 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: action_args: {'id': '966278e6-017a-4267-a3b1-98edbcde5e16'} May 26 15:15:16.423284 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:15:16.423284 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:16.423284 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:15:16.423284 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:15:16.423284 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:15:16.423284 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:15:16.423284 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:15:16.423284 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:15:16.423284 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:15:16.423284 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:15:16.423284 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 966278e6-017a-4267-a3b1-98edbcde5e16 could not be found. May 26 15:15:16.423284 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:15:16.423284 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:15:16.423284 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:15:16.423284 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:16.423284 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:15:16.423284 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:15:16.423284 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:15:16.423284 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:15:16.423284 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:15:16.424430 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:15:16.424430 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:15:16.424430 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:15:16.424430 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:15:16.424430 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:15:16.424430 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:15:16.424430 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:15:16.424430 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 966278e6-017a-4267-a3b1-98edbcde5e16 could not be found. May 26 15:15:16.424430 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:15:16.424430 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:15:16.424430 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:15:16.424430 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:16.424430 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:15:16.424430 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:15:16.424430 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:15:16.424430 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:15:16.424430 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 966278e6-017a-4267-a3b1-98edbcde5e16 could not be found. May 26 15:15:16.424430 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:15:16.426809 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-ca8215af-3310-4bc7-8593-f2bfd3450bc5 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Returning 404 to user: Instance 966278e6-017a-4267-a3b1-98edbcde5e16 could not be found. {{(pid=117799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:15:16.426809 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-ca8215af-3310-4bc7-8593-f2bfd3450bc5 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16" status: 404 len: 111 microversion: 2.1 time: 0.032166 May 26 15:15:16.426809 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 306/576] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:16 2022] GET /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:15:16.432952 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-662db41b-dcba-4524-a63b-0849b7bd7ceb tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '.version_select at 0x7ffb5e879940>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:16.471965 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-662db41b-dcba-4524-a63b-0849b7bd7ceb tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2092088863" status: 202 len: 0 microversion: 2.1 time: 0.042686 May 26 15:15:16.478169 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 271/577] 10.222.0.45 () {58 vars in 1220 bytes} [Thu May 26 15:15:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2092088863 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:15:16.576669 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-d905b090-1c19-4499-894f-4895f5383d8f tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:16.577269 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-d905b090-1c19-4499-894f-4895f5383d8f tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:16.583510 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d905b090-1c19-4499-894f-4895f5383d8f tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:16.584693 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d905b090-1c19-4499-894f-4895f5383d8f tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:16.585620 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d905b090-1c19-4499-894f-4895f5383d8f tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:16.586199 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d905b090-1c19-4499-894f-4895f5383d8f tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:16.781316 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-d905b090-1c19-4499-894f-4895f5383d8f tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:16.789658 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-d905b090-1c19-4499-894f-4895f5383d8f tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1567 microversion: 2.1 time: 0.216675 May 26 15:15:16.790242 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 307/578] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:16 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1567 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:17.199664 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-db3d3b42-bacf-4ef7-8d16-e2067e622359 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:17.200481 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-db3d3b42-bacf-4ef7-8d16-e2067e622359 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:17.209949 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-db3d3b42-bacf-4ef7-8d16-e2067e622359 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:17.209949 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-db3d3b42-bacf-4ef7-8d16-e2067e622359 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:17.209949 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-db3d3b42-bacf-4ef7-8d16-e2067e622359 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:17.209949 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-db3d3b42-bacf-4ef7-8d16-e2067e622359 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:17.304668 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.objects.instance [None req-db3d3b42-bacf-4ef7-8d16-e2067e622359 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lazy-loading 'services' on Instance uuid f969f1fa-bb13-4b63-9095-0881db5202df {{(pid=117798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:15:17.391459 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-db3d3b42-bacf-4ef7-8d16-e2067e622359 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df/os-volume_attachments/f9be0290-06e5-4b28-9b95-02483743f240" status: 202 len: 0 microversion: 2.1 time: 0.195715 May 26 15:15:17.391982 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 272/579] 10.222.0.45 () {58 vars in 1415 bytes} [Thu May 26 15:15:17 2022] DELETE /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df/os-volume_attachments/f9be0290-06e5-4b28-9b95-02483743f240 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:15:17.402244 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-8907b49b-e8de-4610-895d-44253579b800 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:17.403423 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-8907b49b-e8de-4610-895d-44253579b800 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:17.409669 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8907b49b-e8de-4610-895d-44253579b800 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:17.410272 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8907b49b-e8de-4610-895d-44253579b800 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:17.411278 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8907b49b-e8de-4610-895d-44253579b800 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:17.411720 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8907b49b-e8de-4610-895d-44253579b800 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:17.446052 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-8907b49b-e8de-4610-895d-44253579b800 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048536 May 26 15:15:17.446599 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 308/580] 10.222.0.45 () {58 vars in 1301 bytes} [Thu May 26 15:15:17 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:15:17.809622 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c13b6a7f-00f2-43dc-acd3-d6ff57c0c63b tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:17.810330 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c13b6a7f-00f2-43dc-acd3-d6ff57c0c63b tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:17.816443 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c13b6a7f-00f2-43dc-acd3-d6ff57c0c63b tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:17.816878 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c13b6a7f-00f2-43dc-acd3-d6ff57c0c63b tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:17.817622 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c13b6a7f-00f2-43dc-acd3-d6ff57c0c63b tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:17.818542 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c13b6a7f-00f2-43dc-acd3-d6ff57c0c63b tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:17.949857 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c13b6a7f-00f2-43dc-acd3-d6ff57c0c63b tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:17.957629 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c13b6a7f-00f2-43dc-acd3-d6ff57c0c63b tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1567 microversion: 2.1 time: 0.152461 May 26 15:15:17.958209 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 273/581] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:17 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:18.458298 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-09e50172-aa1c-4b62-9318-2ecc60d75621 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:18.460845 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-09e50172-aa1c-4b62-9318-2ecc60d75621 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:18.468221 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-09e50172-aa1c-4b62-9318-2ecc60d75621 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:18.468986 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-09e50172-aa1c-4b62-9318-2ecc60d75621 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:18.469813 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-09e50172-aa1c-4b62-9318-2ecc60d75621 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:18.470424 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-09e50172-aa1c-4b62-9318-2ecc60d75621 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:18.504698 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-09e50172-aa1c-4b62-9318-2ecc60d75621 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050466 May 26 15:15:18.505288 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 309/582] 10.222.0.45 () {58 vars in 1301 bytes} [Thu May 26 15:15:18 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 15:15:18.567351 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-bd025173-feb4-46fc-a841-20b06c9fb6d7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:18.567843 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-bd025173-feb4-46fc-a841-20b06c9fb6d7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:18.574560 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bd025173-feb4-46fc-a841-20b06c9fb6d7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:18.575005 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bd025173-feb4-46fc-a841-20b06c9fb6d7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:18.575848 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bd025173-feb4-46fc-a841-20b06c9fb6d7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:18.576281 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bd025173-feb4-46fc-a841-20b06c9fb6d7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:18.601248 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-bd025173-feb4-46fc-a841-20b06c9fb6d7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Going to try to terminate instance {{(pid=117798) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:15:18.684166 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-bd025173-feb4-46fc-a841-20b06c9fb6d7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 204 len: 0 microversion: 2.1 time: 0.119507 May 26 15:15:18.684914 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 274/583] 10.222.0.45 () {58 vars in 1238 bytes} [Thu May 26 15:15:18 2022] DELETE /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:15:18.694580 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-7615eefb-1b14-4659-8f38-8a5218df9bb1 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:18.695250 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-7615eefb-1b14-4659-8f38-8a5218df9bb1 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:18.701516 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7615eefb-1b14-4659-8f38-8a5218df9bb1 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:18.701962 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7615eefb-1b14-4659-8f38-8a5218df9bb1 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:18.703004 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7615eefb-1b14-4659-8f38-8a5218df9bb1 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:18.703474 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7615eefb-1b14-4659-8f38-8a5218df9bb1 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:18.706217 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:15:18.840111 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-7615eefb-1b14-4659-8f38-8a5218df9bb1 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:18.847812 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-7615eefb-1b14-4659-8f38-8a5218df9bb1 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1682 microversion: 2.1 time: 0.158422 May 26 15:15:18.848379 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 310/584] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:18 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:18.975716 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ca4f99b3-3251-4421-8a88-1e5218763520 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:18.976399 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ca4f99b3-3251-4421-8a88-1e5218763520 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:18.982754 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ca4f99b3-3251-4421-8a88-1e5218763520 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:18.984319 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ca4f99b3-3251-4421-8a88-1e5218763520 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:18.985645 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ca4f99b3-3251-4421-8a88-1e5218763520 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:18.986070 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ca4f99b3-3251-4421-8a88-1e5218763520 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:19.120201 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ca4f99b3-3251-4421-8a88-1e5218763520 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:19.127709 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ca4f99b3-3251-4421-8a88-1e5218763520 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1567 microversion: 2.1 time: 0.156404 May 26 15:15:19.128280 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 275/585] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:18 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:19.865878 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-3c562c3a-36eb-435a-9b86-558c44e6feee tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:19.866483 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-3c562c3a-36eb-435a-9b86-558c44e6feee tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:19.873343 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-3c562c3a-36eb-435a-9b86-558c44e6feee tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:19.873784 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-3c562c3a-36eb-435a-9b86-558c44e6feee tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:19.874657 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-3c562c3a-36eb-435a-9b86-558c44e6feee tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:19.875104 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-3c562c3a-36eb-435a-9b86-558c44e6feee tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:20.015023 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-3c562c3a-36eb-435a-9b86-558c44e6feee tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:20.026992 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-3c562c3a-36eb-435a-9b86-558c44e6feee tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1682 microversion: 2.1 time: 0.164748 May 26 15:15:20.027939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 311/586] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:19 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:20.145624 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-7d7e801e-623b-4598-b2b1-e824e506979d tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:20.146814 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-7d7e801e-623b-4598-b2b1-e824e506979d tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:20.153283 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7d7e801e-623b-4598-b2b1-e824e506979d tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:20.153724 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7d7e801e-623b-4598-b2b1-e824e506979d tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:20.154479 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7d7e801e-623b-4598-b2b1-e824e506979d tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:20.154913 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7d7e801e-623b-4598-b2b1-e824e506979d tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:20.170934 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:15:20.313563 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7d7e801e-623b-4598-b2b1-e824e506979d tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:20.322775 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-7d7e801e-623b-4598-b2b1-e824e506979d tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1567 microversion: 2.1 time: 0.181215 May 26 15:15:20.323434 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 276/587] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:20 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:21.014448 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-30d2fb93-918f-47c8-a8c2-e01781161986 req-ce3ceab7-1a06-4d28-8521-c8b519fcc7e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f969f1fa-bb13-4b63-9095-0881db5202df", "name": "network-vif-deleted", "tag": "e5676082-5402-41ae-be68-6d928c3d3d18"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:15:21.023371 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-30d2fb93-918f-47c8-a8c2-e01781161986 req-ce3ceab7-1a06-4d28-8521-c8b519fcc7e0 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:21.023811 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-30d2fb93-918f-47c8-a8c2-e01781161986 req-ce3ceab7-1a06-4d28-8521-c8b519fcc7e0 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:21.035459 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-30d2fb93-918f-47c8-a8c2-e01781161986 req-ce3ceab7-1a06-4d28-8521-c8b519fcc7e0 service nova] Creating event network-vif-deleted:e5676082-5402-41ae-be68-6d928c3d3d18 for instance f969f1fa-bb13-4b63-9095-0881db5202df on hv-cinder-84301 May 26 15:15:21.041034 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-30d2fb93-918f-47c8-a8c2-e01781161986 req-ce3ceab7-1a06-4d28-8521-c8b519fcc7e0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030086 May 26 15:15:21.041656 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 312/588] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:15:21.048227 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-15f2a4fe-cd72-4d74-a567-b89040cba116 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:21.048849 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-15f2a4fe-cd72-4d74-a567-b89040cba116 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:21.060436 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-15f2a4fe-cd72-4d74-a567-b89040cba116 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:21.063528 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-15f2a4fe-cd72-4d74-a567-b89040cba116 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:21.065618 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-15f2a4fe-cd72-4d74-a567-b89040cba116 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:21.066142 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-15f2a4fe-cd72-4d74-a567-b89040cba116 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:21.145013 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-15f2a4fe-cd72-4d74-a567-b89040cba116 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:21.155542 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-15f2a4fe-cd72-4d74-a567-b89040cba116 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 200 len: 1327 microversion: 2.1 time: 0.111431 May 26 15:15:21.156821 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 277/589] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:21 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 1327 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:21.345234 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-dc4d8722-b8a3-4708-9f7e-2eb937c999d6 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:21.345920 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-dc4d8722-b8a3-4708-9f7e-2eb937c999d6 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:21.352783 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dc4d8722-b8a3-4708-9f7e-2eb937c999d6 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:21.353231 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dc4d8722-b8a3-4708-9f7e-2eb937c999d6 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:21.353984 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dc4d8722-b8a3-4708-9f7e-2eb937c999d6 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:21.354415 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dc4d8722-b8a3-4708-9f7e-2eb937c999d6 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:21.508380 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-dc4d8722-b8a3-4708-9f7e-2eb937c999d6 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:21.519721 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-dc4d8722-b8a3-4708-9f7e-2eb937c999d6 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1567 microversion: 2.1 time: 0.178256 May 26 15:15:21.520358 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 313/590] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:21 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:22.173995 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b730e43b-f2ff-4344-b277-4eaa2a1e3be7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:22.174513 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b730e43b-f2ff-4344-b277-4eaa2a1e3be7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:22.181870 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b730e43b-f2ff-4344-b277-4eaa2a1e3be7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:22.182314 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b730e43b-f2ff-4344-b277-4eaa2a1e3be7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:22.183076 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b730e43b-f2ff-4344-b277-4eaa2a1e3be7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:22.183527 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b730e43b-f2ff-4344-b277-4eaa2a1e3be7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:22.199067 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-b730e43b-f2ff-4344-b277-4eaa2a1e3be7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] HTTP exception thrown: Instance f969f1fa-bb13-4b63-9095-0881db5202df could not be found. May 26 15:15:22.200747 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b730e43b-f2ff-4344-b277-4eaa2a1e3be7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Request method failure captured: May 26 15:15:22.200747 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: request: GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df HTTP/1.1 May 26 15:15:22.200747 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept: application/json May 26 15:15:22.200747 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity May 26 15:15:22.200747 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Connection: close May 26 15:15:22.200747 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Length: 0 May 26 15:15:22.200747 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Type: application/json May 26 15:15:22.200747 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Host: 10.222.0.45 May 26 15:15:22.200747 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None May 26 15:15:22.200747 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 May 26 15:15:22.200747 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABij5gKsz5qj5DNdZrMFjr-Jr5xg2mNFFRPkTRxdAGsu10bP3EnBAcmrx6BKDNDgfsXd480T_XTCyywquChHsMxkBXmsyJsxmtyqnYAiCUvnNXzq6C4KvbHPcEIVG_Dh3vBN1K_0JPHyQtkc2u3wwrrdDbhsPbSJJLP4Pdm3CUM8QN6AT4 May 26 15:15:22.200747 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Id: None May 26 15:15:22.200747 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Name: None May 26 15:15:22.200747 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed May 26 15:15:22.200747 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True May 26 15:15:22.200747 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default May 26 15:15:22.200747 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default May 26 15:15:22.200747 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Id: 196700c560cd4d6e9461ec9571facf39 May 26 15:15:22.200747 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-AttachVolumeNegativeTest-1949965076 May 26 15:15:22.200747 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Role: reader,member May 26 15:15:22.200747 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Roles: reader,member May 26 15:15:22.201964 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/196700c560cd4d6e9461ec9571facf39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/196700c560cd4d6e9461ec9571facf39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/196700c560cd4d6e9461ec9571facf39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_196700c560cd4d6e9461ec9571facf39"}]}] May 26 15:15:22.201964 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-AttachVolumeNegativeTest-1949965076 May 26 15:15:22.201964 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Id: 196700c560cd4d6e9461ec9571facf39 May 26 15:15:22.201964 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1949965076 May 26 15:15:22.201964 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User: tempest-AttachVolumeNegativeTest-1949965076-project May 26 15:15:22.201964 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default May 26 15:15:22.201964 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default May 26 15:15:22.201964 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Id: 1421fb674ae04d6ea9ae342b73ce8115 May 26 15:15:22.201964 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-AttachVolumeNegativeTest-1949965076-project May 26 15:15:22.201964 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: method: > May 26 15:15:22.201964 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: exception: Instance f969f1fa-bb13-4b63-9095-0881db5202df could not be found. May 26 15:15:22.201964 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: action_args: {'id': 'f969f1fa-bb13-4b63-9095-0881db5202df'} May 26 15:15:22.202645 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:15:22.202645 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:22.202645 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:15:22.202645 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:15:22.202645 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:15:22.202645 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:15:22.202645 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:15:22.202645 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:15:22.202645 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:15:22.202645 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:15:22.202645 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f969f1fa-bb13-4b63-9095-0881db5202df could not be found. May 26 15:15:22.202645 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:15:22.202645 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:15:22.202645 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:15:22.202645 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:22.202645 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:15:22.202645 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:15:22.202645 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:15:22.202645 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:15:22.202645 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:15:22.203900 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:15:22.203900 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:15:22.203900 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:15:22.203900 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:15:22.203900 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:15:22.203900 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:15:22.203900 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:15:22.203900 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f969f1fa-bb13-4b63-9095-0881db5202df could not be found. May 26 15:15:22.203900 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:15:22.203900 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:15:22.203900 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:15:22.203900 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:22.203900 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:15:22.203900 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:15:22.203900 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:15:22.203900 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:15:22.203900 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f969f1fa-bb13-4b63-9095-0881db5202df could not be found. May 26 15:15:22.203900 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:15:22.205129 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b730e43b-f2ff-4344-b277-4eaa2a1e3be7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Returning 404 to user: Instance f969f1fa-bb13-4b63-9095-0881db5202df could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:15:22.205129 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b730e43b-f2ff-4344-b277-4eaa2a1e3be7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 404 len: 111 microversion: 2.1 time: 0.032259 May 26 15:15:22.205129 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 278/591] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:22 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:15:22.212001 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-a8d353b4-00fb-49c2-a2be-a5e8b76856e3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '.version_select at 0x7ffb5d6da8b0>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:22.230916 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-a8d353b4-00fb-49c2-a2be-a5e8b76856e3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1904351988" status: 202 len: 0 microversion: 2.1 time: 0.023491 May 26 15:15:22.231520 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 314/592] 10.222.0.45 () {58 vars in 1220 bytes} [Thu May 26 15:15:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1904351988 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:15:22.538940 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-0a2fea22-05bd-483b-8766-91db21f077b6 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:22.539603 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-0a2fea22-05bd-483b-8766-91db21f077b6 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:22.545689 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0a2fea22-05bd-483b-8766-91db21f077b6 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:22.546127 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0a2fea22-05bd-483b-8766-91db21f077b6 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:22.546904 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0a2fea22-05bd-483b-8766-91db21f077b6 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:22.547360 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0a2fea22-05bd-483b-8766-91db21f077b6 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:22.791404 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-0a2fea22-05bd-483b-8766-91db21f077b6 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:22.799036 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-0a2fea22-05bd-483b-8766-91db21f077b6 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1567 microversion: 2.1 time: 0.265193 May 26 15:15:22.799655 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 279/593] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:22 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1567 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:22.942338 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-b714750a-d29b-419f-8cb0-14eb38ce4c8b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Action: 'create', calling method: .version_select at 0x7ffb5d68ce50>, body: {"keypair": {"name": "tempest-keypair-510980125", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXyjQT0wrs45xhIg5Rl+fqdOc8tJ8WCltMz8apwLJWJABrIMTWJa8WO2tNxDxx5AeaTXqGqgayDPgEn4xh5w+qmiLIiJPe82h0A53FmFMYTONAdQ2k4YwWYV62RiRz65Q=="}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:15:22.959154 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.quota [None req-b714750a-d29b-419f-8cb0-14eb38ce4c8b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Getting quotas for project 196700c560cd4d6e9461ec9571facf39. Resources: {'key_pairs'} {{(pid=117799) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:15:22.963649 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.quota [None req-b714750a-d29b-419f-8cb0-14eb38ce4c8b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Getting quotas for user 1421fb674ae04d6ea9ae342b73ce8115 and project 196700c560cd4d6e9461ec9571facf39. Resources: {'key_pairs'} {{(pid=117799) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:15:22.987598 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-b714750a-d29b-419f-8cb0-14eb38ce4c8b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049141 May 26 15:15:22.988200 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 315/594] 10.222.0.45 () {60 vars in 1158 bytes} [Thu May 26 15:15:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:15:23.815431 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-16c7b406-2ce6-4bf5-9c8b-40ee07e8cd31 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:23.816033 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-16c7b406-2ce6-4bf5-9c8b-40ee07e8cd31 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:23.823409 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-16c7b406-2ce6-4bf5-9c8b-40ee07e8cd31 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:23.823859 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-16c7b406-2ce6-4bf5-9c8b-40ee07e8cd31 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:23.824637 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-16c7b406-2ce6-4bf5-9c8b-40ee07e8cd31 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:23.825072 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-16c7b406-2ce6-4bf5-9c8b-40ee07e8cd31 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:23.970274 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-16c7b406-2ce6-4bf5-9c8b-40ee07e8cd31 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:23.978285 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-16c7b406-2ce6-4bf5-9c8b-40ee07e8cd31 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1567 microversion: 2.1 time: 0.166780 May 26 15:15:23.978870 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 280/595] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:23 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:24.560465 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-54dfbfc6-a233-4084-a645-04851d5cd155 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-555875115", "imageRef": "5b5a68b4-38e3-4f05-b97f-4339d6752e34", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aeb58b02-96d6-4f2b-8272-441acfd1f591"}], "security_groups": [{"name": "tempest-securitygroup--1357973355"}], "key_name": "tempest-keypair-510980125", "user_data": "}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:15:24.661228 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.network.neutron [None req-54dfbfc6-a233-4084-a645-04851d5cd155 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] validate_networks() for [('aeb58b02-96d6-4f2b-8272-441acfd1f591', None, None, None, None, None)] {{(pid=117799) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:15:24.997149 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ab6cb89f-e982-4e80-9fdf-e6a0b8100cae tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:24.997766 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ab6cb89f-e982-4e80-9fdf-e6a0b8100cae tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:25.005073 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ab6cb89f-e982-4e80-9fdf-e6a0b8100cae tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:25.005643 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ab6cb89f-e982-4e80-9fdf-e6a0b8100cae tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:25.007453 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ab6cb89f-e982-4e80-9fdf-e6a0b8100cae tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:25.007910 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ab6cb89f-e982-4e80-9fdf-e6a0b8100cae tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:25.131073 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-54dfbfc6-a233-4084-a645-04851d5cd155 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Flavor limits 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:15:25.131562 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-54dfbfc6-a233-4084-a645-04851d5cd155 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Image limits 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:15:25.132037 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-54dfbfc6-a233-4084-a645-04851d5cd155 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Flavor pref 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:15:25.132442 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-54dfbfc6-a233-4084-a645-04851d5cd155 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Image pref 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:15:25.132853 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-54dfbfc6-a233-4084-a645-04851d5cd155 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:15:25.142375 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-54dfbfc6-a233-4084-a645-04851d5cd155 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:25.142822 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-54dfbfc6-a233-4084-a645-04851d5cd155 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:25.143814 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-54dfbfc6-a233-4084-a645-04851d5cd155 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:25.144498 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-54dfbfc6-a233-4084-a645-04851d5cd155 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:25.163219 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.quota [None req-54dfbfc6-a233-4084-a645-04851d5cd155 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Getting quotas for project 196700c560cd4d6e9461ec9571facf39. Resources: {'cores', 'ram', 'instances'} {{(pid=117799) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:15:25.167441 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.quota [None req-54dfbfc6-a233-4084-a645-04851d5cd155 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Getting quotas for user 1421fb674ae04d6ea9ae342b73ce8115 and project 196700c560cd4d6e9461ec9571facf39. Resources: {'cores', 'ram', 'instances'} {{(pid=117799) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:15:25.170256 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ab6cb89f-e982-4e80-9fdf-e6a0b8100cae tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:25.179011 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ab6cb89f-e982-4e80-9fdf-e6a0b8100cae tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1567 microversion: 2.1 time: 0.185874 May 26 15:15:25.179731 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 281/596] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:24 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:15:25.181814 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-54dfbfc6-a233-4084-a645-04851d5cd155 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Going to run 1 instances... {{(pid=117799) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:15:25.184184 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-54dfbfc6-a233-4084-a645-04851d5cd155 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 819b82d5-9c2d-4302-a0ad-ba9f20cac568] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5b5a68b4-38e3-4f05-b97f-4339d6752e34',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117799) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:15:25.256334 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-54dfbfc6-a233-4084-a645-04851d5cd155 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.700130 May 26 15:15:25.257062 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 316/597] 10.222.0.45 () {60 vars in 1146 bytes} [Thu May 26 15:15:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 15:15:25.272454 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ae423a0f-1568-41fe-8fd9-876ed4c589e7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:25.273071 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ae423a0f-1568-41fe-8fd9-876ed4c589e7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 819b82d5-9c2d-4302-a0ad-ba9f20cac568] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:25.330019 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ae423a0f-1568-41fe-8fd9-876ed4c589e7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:25.337728 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ae423a0f-1568-41fe-8fd9-876ed4c589e7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568" status: 200 len: 1240 microversion: 2.1 time: 0.069779 May 26 15:15:25.339327 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 282/598] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:25 2022] GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568 => generated 1240 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:26.203364 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-de7e2697-13af-46b6-af38-37c5015663ac tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:26.204425 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-de7e2697-13af-46b6-af38-37c5015663ac tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:26.212097 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-de7e2697-13af-46b6-af38-37c5015663ac tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:26.212546 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-de7e2697-13af-46b6-af38-37c5015663ac tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:26.213524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-de7e2697-13af-46b6-af38-37c5015663ac tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:26.214125 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-de7e2697-13af-46b6-af38-37c5015663ac tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:26.359542 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-0df7dc58-045c-40e9-b949-94f1b6bbb7e9 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:26.360897 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-0df7dc58-045c-40e9-b949-94f1b6bbb7e9 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 819b82d5-9c2d-4302-a0ad-ba9f20cac568] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:26.371153 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-de7e2697-13af-46b6-af38-37c5015663ac tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:26.371883 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0df7dc58-045c-40e9-b949-94f1b6bbb7e9 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:26.372495 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0df7dc58-045c-40e9-b949-94f1b6bbb7e9 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:26.373669 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0df7dc58-045c-40e9-b949-94f1b6bbb7e9 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:26.375716 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0df7dc58-045c-40e9-b949-94f1b6bbb7e9 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:26.382394 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-de7e2697-13af-46b6-af38-37c5015663ac tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1567 microversion: 2.1 time: 0.181341 May 26 15:15:26.382394 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 317/599] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:26 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:26.462873 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-0df7dc58-045c-40e9-b949-94f1b6bbb7e9 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:26.477287 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-0df7dc58-045c-40e9-b949-94f1b6bbb7e9 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568" status: 200 len: 1310 microversion: 2.1 time: 0.123295 May 26 15:15:26.478277 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 283/600] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:26 2022] GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568 => generated 1310 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:27.409032 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-e141bc5b-686b-46fe-a71b-bd386b17b368 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:27.409663 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-e141bc5b-686b-46fe-a71b-bd386b17b368 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:27.422090 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e141bc5b-686b-46fe-a71b-bd386b17b368 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:27.422467 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e141bc5b-686b-46fe-a71b-bd386b17b368 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:27.423299 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e141bc5b-686b-46fe-a71b-bd386b17b368 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:27.423731 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e141bc5b-686b-46fe-a71b-bd386b17b368 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:27.495320 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-45f52181-74b3-44c3-b31c-217a502f91f4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:27.495931 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-45f52181-74b3-44c3-b31c-217a502f91f4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 819b82d5-9c2d-4302-a0ad-ba9f20cac568] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:27.503666 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-45f52181-74b3-44c3-b31c-217a502f91f4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:27.504392 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-45f52181-74b3-44c3-b31c-217a502f91f4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:27.505212 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-45f52181-74b3-44c3-b31c-217a502f91f4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:27.505816 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-45f52181-74b3-44c3-b31c-217a502f91f4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:27.621681 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-e141bc5b-686b-46fe-a71b-bd386b17b368 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:27.648025 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-e141bc5b-686b-46fe-a71b-bd386b17b368 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1567 microversion: 2.1 time: 0.245862 May 26 15:15:27.650106 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 318/601] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:27 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:27.679979 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-45f52181-74b3-44c3-b31c-217a502f91f4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:27.691740 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-45f52181-74b3-44c3-b31c-217a502f91f4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568" status: 200 len: 1366 microversion: 2.1 time: 0.201628 May 26 15:15:27.692354 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 284/602] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:27 2022] GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568 => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:15:27.886615 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-0e1cd556-17c5-4cff-a5cb-4f98273b3697 req-af47d661-09a0-46df-9e25-5b9a3c7266eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "819b82d5-9c2d-4302-a0ad-ba9f20cac568", "tag": "8b9cfb27-2ff7-44f9-80b9-917b08868d33"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:15:27.895553 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-0e1cd556-17c5-4cff-a5cb-4f98273b3697 req-af47d661-09a0-46df-9e25-5b9a3c7266eb service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:27.896142 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-0e1cd556-17c5-4cff-a5cb-4f98273b3697 req-af47d661-09a0-46df-9e25-5b9a3c7266eb service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:27.912100 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-0e1cd556-17c5-4cff-a5cb-4f98273b3697 req-af47d661-09a0-46df-9e25-5b9a3c7266eb service nova] Creating event network-changed:8b9cfb27-2ff7-44f9-80b9-917b08868d33 for instance 819b82d5-9c2d-4302-a0ad-ba9f20cac568 on hv-cinder-84301 May 26 15:15:27.920681 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-0e1cd556-17c5-4cff-a5cb-4f98273b3697 req-af47d661-09a0-46df-9e25-5b9a3c7266eb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038563 May 26 15:15:27.921695 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 319/603] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:15:28.665468 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-72e7d70d-cfe0-4da2-a5aa-c5c3dcf07ed5 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:28.666012 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-72e7d70d-cfe0-4da2-a5aa-c5c3dcf07ed5 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:28.672746 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-72e7d70d-cfe0-4da2-a5aa-c5c3dcf07ed5 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:28.673200 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-72e7d70d-cfe0-4da2-a5aa-c5c3dcf07ed5 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:28.673968 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-72e7d70d-cfe0-4da2-a5aa-c5c3dcf07ed5 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:28.674405 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-72e7d70d-cfe0-4da2-a5aa-c5c3dcf07ed5 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:28.711992 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-6a8ee40d-e717-44c3-abc0-5bf912dfd3db tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:28.712768 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-6a8ee40d-e717-44c3-abc0-5bf912dfd3db tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 819b82d5-9c2d-4302-a0ad-ba9f20cac568] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:28.719776 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6a8ee40d-e717-44c3-abc0-5bf912dfd3db tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:28.720218 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6a8ee40d-e717-44c3-abc0-5bf912dfd3db tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:28.720998 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6a8ee40d-e717-44c3-abc0-5bf912dfd3db tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:28.721431 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6a8ee40d-e717-44c3-abc0-5bf912dfd3db tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:28.872552 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-72e7d70d-cfe0-4da2-a5aa-c5c3dcf07ed5 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:28.880599 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-72e7d70d-cfe0-4da2-a5aa-c5c3dcf07ed5 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1567 microversion: 2.1 time: 0.218889 May 26 15:15:28.881324 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 285/604] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:28 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1567 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:28.899108 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-6a8ee40d-e717-44c3-abc0-5bf912dfd3db tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:28.906669 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-6a8ee40d-e717-44c3-abc0-5bf912dfd3db tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568" status: 200 len: 1366 microversion: 2.1 time: 0.200367 May 26 15:15:28.907269 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 320/605] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:28 2022] GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568 => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:15:29.899428 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ab487eb4-0765-40a9-8d58-22b74d811f5e tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:29.900024 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ab487eb4-0765-40a9-8d58-22b74d811f5e tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:29.906587 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ab487eb4-0765-40a9-8d58-22b74d811f5e tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:29.907034 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ab487eb4-0765-40a9-8d58-22b74d811f5e tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:29.907826 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ab487eb4-0765-40a9-8d58-22b74d811f5e tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:29.908254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ab487eb4-0765-40a9-8d58-22b74d811f5e tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:29.924272 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-c192c9ef-c689-4f62-aac8-66440aca0b46 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:29.924868 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-c192c9ef-c689-4f62-aac8-66440aca0b46 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 819b82d5-9c2d-4302-a0ad-ba9f20cac568] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:29.932205 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c192c9ef-c689-4f62-aac8-66440aca0b46 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:29.932642 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c192c9ef-c689-4f62-aac8-66440aca0b46 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:29.933412 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c192c9ef-c689-4f62-aac8-66440aca0b46 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:29.933843 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c192c9ef-c689-4f62-aac8-66440aca0b46 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:30.117296 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ab487eb4-0765-40a9-8d58-22b74d811f5e tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:30.121678 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-c192c9ef-c689-4f62-aac8-66440aca0b46 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:30.125866 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ab487eb4-0765-40a9-8d58-22b74d811f5e tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1567 microversion: 2.1 time: 0.230931 May 26 15:15:30.126537 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 286/606] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:29 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1567 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:30.129294 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-c192c9ef-c689-4f62-aac8-66440aca0b46 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568" status: 200 len: 1366 microversion: 2.1 time: 0.209103 May 26 15:15:30.129873 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 321/607] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:29 2022] GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568 => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:15:31.144429 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-87a2fde4-0b74-48ca-83ad-ad4e3acc4a07 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:31.145044 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-87a2fde4-0b74-48ca-83ad-ad4e3acc4a07 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:31.148389 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-f49ad4dd-b9a1-4940-a133-b7c14cb32b68 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:31.148993 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-f49ad4dd-b9a1-4940-a133-b7c14cb32b68 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 819b82d5-9c2d-4302-a0ad-ba9f20cac568] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:31.152592 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-87a2fde4-0b74-48ca-83ad-ad4e3acc4a07 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:31.153047 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-87a2fde4-0b74-48ca-83ad-ad4e3acc4a07 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:31.153833 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-87a2fde4-0b74-48ca-83ad-ad4e3acc4a07 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:31.154271 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-87a2fde4-0b74-48ca-83ad-ad4e3acc4a07 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:31.155714 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f49ad4dd-b9a1-4940-a133-b7c14cb32b68 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:31.156185 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f49ad4dd-b9a1-4940-a133-b7c14cb32b68 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:31.157003 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f49ad4dd-b9a1-4940-a133-b7c14cb32b68 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:31.157453 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f49ad4dd-b9a1-4940-a133-b7c14cb32b68 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:31.356857 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-f49ad4dd-b9a1-4940-a133-b7c14cb32b68 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:31.359942 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-87a2fde4-0b74-48ca-83ad-ad4e3acc4a07 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:31.366073 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-f49ad4dd-b9a1-4940-a133-b7c14cb32b68 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568" status: 200 len: 1366 microversion: 2.1 time: 0.222727 May 26 15:15:31.366666 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 322/608] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:31 2022] GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:15:31.368263 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-87a2fde4-0b74-48ca-83ad-ad4e3acc4a07 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1567 microversion: 2.1 time: 0.228027 May 26 15:15:31.368839 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 287/609] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:31 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1567 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:32.383250 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-f62ddfb9-6b34-4208-81e5-9fd78edb3320 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:32.383858 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-f62ddfb9-6b34-4208-81e5-9fd78edb3320 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 819b82d5-9c2d-4302-a0ad-ba9f20cac568] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:32.385785 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f23ce352-ad8d-41d9-ad2b-864f1526e646 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:32.386342 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:15:32.386473 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f23ce352-ad8d-41d9-ad2b-864f1526e646 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:32.391756 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f62ddfb9-6b34-4208-81e5-9fd78edb3320 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:32.392198 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f62ddfb9-6b34-4208-81e5-9fd78edb3320 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:32.392962 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f62ddfb9-6b34-4208-81e5-9fd78edb3320 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:32.393244 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f23ce352-ad8d-41d9-ad2b-864f1526e646 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:32.393387 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f62ddfb9-6b34-4208-81e5-9fd78edb3320 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:32.393694 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f23ce352-ad8d-41d9-ad2b-864f1526e646 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:32.395065 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f23ce352-ad8d-41d9-ad2b-864f1526e646 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:32.395796 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f23ce352-ad8d-41d9-ad2b-864f1526e646 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:32.593621 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-f62ddfb9-6b34-4208-81e5-9fd78edb3320 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:32.597605 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f23ce352-ad8d-41d9-ad2b-864f1526e646 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:32.601795 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-f62ddfb9-6b34-4208-81e5-9fd78edb3320 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568" status: 200 len: 1366 microversion: 2.1 time: 0.223546 May 26 15:15:32.602374 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 323/610] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:32 2022] GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:32.606693 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f23ce352-ad8d-41d9-ad2b-864f1526e646 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1567 microversion: 2.1 time: 0.224677 May 26 15:15:32.607297 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 288/611] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:32 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1567 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:15:33.618357 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-a385c094-260c-46cf-ba46-d32d59a0bdc9 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:33.619102 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-a385c094-260c-46cf-ba46-d32d59a0bdc9 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 819b82d5-9c2d-4302-a0ad-ba9f20cac568] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:33.624246 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-dc10e74b-b708-49d1-b9f7-bbf6c5a52824 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:33.624990 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-dc10e74b-b708-49d1-b9f7-bbf6c5a52824 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:33.626865 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a385c094-260c-46cf-ba46-d32d59a0bdc9 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:33.627355 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a385c094-260c-46cf-ba46-d32d59a0bdc9 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:33.628372 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a385c094-260c-46cf-ba46-d32d59a0bdc9 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:33.628560 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a385c094-260c-46cf-ba46-d32d59a0bdc9 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:33.632417 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dc10e74b-b708-49d1-b9f7-bbf6c5a52824 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:33.633495 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dc10e74b-b708-49d1-b9f7-bbf6c5a52824 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:33.634247 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dc10e74b-b708-49d1-b9f7-bbf6c5a52824 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:33.634521 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dc10e74b-b708-49d1-b9f7-bbf6c5a52824 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:33.832877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-a385c094-260c-46cf-ba46-d32d59a0bdc9 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:33.838439 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-dc10e74b-b708-49d1-b9f7-bbf6c5a52824 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:33.840983 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-a385c094-260c-46cf-ba46-d32d59a0bdc9 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568" status: 200 len: 1366 microversion: 2.1 time: 0.226614 May 26 15:15:33.841764 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 324/612] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:33 2022] GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:33.846200 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-dc10e74b-b708-49d1-b9f7-bbf6c5a52824 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1567 microversion: 2.1 time: 0.225704 May 26 15:15:33.846861 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 289/613] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:33 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1567 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:15:34.858673 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-19943e79-8c30-42ab-a826-546892ecc7cd tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:34.859340 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-19943e79-8c30-42ab-a826-546892ecc7cd tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 819b82d5-9c2d-4302-a0ad-ba9f20cac568] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:34.864918 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-eda4f3a8-5401-484b-ab0b-fee220564534 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:34.865531 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-eda4f3a8-5401-484b-ab0b-fee220564534 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:34.866094 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-19943e79-8c30-42ab-a826-546892ecc7cd tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:34.866545 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-19943e79-8c30-42ab-a826-546892ecc7cd tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:34.867353 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-19943e79-8c30-42ab-a826-546892ecc7cd tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:34.867791 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-19943e79-8c30-42ab-a826-546892ecc7cd tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:34.872441 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-eda4f3a8-5401-484b-ab0b-fee220564534 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:34.873165 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-eda4f3a8-5401-484b-ab0b-fee220564534 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:34.873995 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-eda4f3a8-5401-484b-ab0b-fee220564534 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:34.874639 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-eda4f3a8-5401-484b-ab0b-fee220564534 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:35.079829 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-19943e79-8c30-42ab-a826-546892ecc7cd tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:35.087596 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-eda4f3a8-5401-484b-ab0b-fee220564534 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:35.091570 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-19943e79-8c30-42ab-a826-546892ecc7cd tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568" status: 200 len: 1366 microversion: 2.1 time: 0.235900 May 26 15:15:35.101143 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 325/614] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:34 2022] GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568 => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:35.104246 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-eda4f3a8-5401-484b-ab0b-fee220564534 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1568 microversion: 2.1 time: 0.243896 May 26 15:15:35.104951 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 290/615] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:34 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1568 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:35.123166 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-53bdd8fd-cf12-468a-803c-a7efa7415c56 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:15:35.123731 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-53bdd8fd-cf12-468a-803c-a7efa7415c56 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:35.131169 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-53bdd8fd-cf12-468a-803c-a7efa7415c56 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:35.131169 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-53bdd8fd-cf12-468a-803c-a7efa7415c56 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:35.132034 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-53bdd8fd-cf12-468a-803c-a7efa7415c56 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:35.132646 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-53bdd8fd-cf12-468a-803c-a7efa7415c56 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:35.155037 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell0:SELECT=2 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:15:35.177395 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell0:SELECT=10 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:15:35.204851 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-325d99b7-c7ab-4ece-b6a1-6851b663e56d req-c21d0bc5-602e-4625-8e2a-8c2a585619be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "819b82d5-9c2d-4302-a0ad-ba9f20cac568", "name": "network-vif-plugged", "status": "completed", "tag": "8b9cfb27-2ff7-44f9-80b9-917b08868d33"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:15:35.214891 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-325d99b7-c7ab-4ece-b6a1-6851b663e56d req-c21d0bc5-602e-4625-8e2a-8c2a585619be service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:35.215379 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-325d99b7-c7ab-4ece-b6a1-6851b663e56d req-c21d0bc5-602e-4625-8e2a-8c2a585619be service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:35.228459 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-325d99b7-c7ab-4ece-b6a1-6851b663e56d req-c21d0bc5-602e-4625-8e2a-8c2a585619be service nova] Creating event network-vif-plugged:8b9cfb27-2ff7-44f9-80b9-917b08868d33 for instance 819b82d5-9c2d-4302-a0ad-ba9f20cac568 on hv-cinder-84301 May 26 15:15:35.234320 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-325d99b7-c7ab-4ece-b6a1-6851b663e56d req-c21d0bc5-602e-4625-8e2a-8c2a585619be service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106782 May 26 15:15:35.235367 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 291/616] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:15:35.243779 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-53bdd8fd-cf12-468a-803c-a7efa7415c56 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "POST /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926/action" status: 202 len: 0 microversion: 2.1 time: 0.124577 May 26 15:15:35.244501 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 326/617] 10.222.0.45 () {60 vars in 1277 bytes} [Thu May 26 15:15:35 2022] POST /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:15:35.255731 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-4eead96c-d4d4-41e4-a3e0-23d3f8e69ae1 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:35.257840 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-4eead96c-d4d4-41e4-a3e0-23d3f8e69ae1 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:35.265518 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4eead96c-d4d4-41e4-a3e0-23d3f8e69ae1 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:35.266251 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4eead96c-d4d4-41e4-a3e0-23d3f8e69ae1 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:35.267347 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4eead96c-d4d4-41e4-a3e0-23d3f8e69ae1 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:35.268331 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4eead96c-d4d4-41e4-a3e0-23d3f8e69ae1 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:35.335178 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=2 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:15:35.430610 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-630620e8-c586-43c8-9260-962b90627ca5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:35.431112 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-630620e8-c586-43c8-9260-962b90627ca5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:35.437405 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-630620e8-c586-43c8-9260-962b90627ca5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:35.437852 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-630620e8-c586-43c8-9260-962b90627ca5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:35.438614 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-630620e8-c586-43c8-9260-962b90627ca5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:35.439039 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-630620e8-c586-43c8-9260-962b90627ca5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:35.448748 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-4eead96c-d4d4-41e4-a3e0-23d3f8e69ae1 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:35.456549 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-4eead96c-d4d4-41e4-a3e0-23d3f8e69ae1 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1576 microversion: 2.1 time: 0.206946 May 26 15:15:35.457382 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 292/618] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:35 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1576 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:35.484713 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-630620e8-c586-43c8-9260-962b90627ca5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6/os-volume_attachments/da502465-486d-46f9-a6e2-e56912980856" status: 200 len: 194 microversion: 2.20 time: 0.058319 May 26 15:15:35.484846 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 327/619] 10.222.0.45 () {60 vars in 1453 bytes} [Thu May 26 15:15:35 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6/os-volume_attachments/da502465-486d-46f9-a6e2-e56912980856 => generated 194 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 15:15:35.555648 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-74fae0bd-c59e-42df-a216-5c936338010b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:35.556212 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-74fae0bd-c59e-42df-a216-5c936338010b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:35.562348 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-74fae0bd-c59e-42df-a216-5c936338010b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:35.562789 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-74fae0bd-c59e-42df-a216-5c936338010b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:35.563648 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-74fae0bd-c59e-42df-a216-5c936338010b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:35.563995 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-74fae0bd-c59e-42df-a216-5c936338010b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:35.651322 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.objects.instance [None req-74fae0bd-c59e-42df-a216-5c936338010b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lazy-loading 'services' on Instance uuid 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 {{(pid=117798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:15:35.737331 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-74fae0bd-c59e-42df-a216-5c936338010b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6/os-volume_attachments/da502465-486d-46f9-a6e2-e56912980856" status: 202 len: 0 microversion: 2.20 time: 0.185684 May 26 15:15:35.737827 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 293/620] 10.222.0.45 () {60 vars in 1456 bytes} [Thu May 26 15:15:35 2022] DELETE /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6/os-volume_attachments/da502465-486d-46f9-a6e2-e56912980856 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 15:15:35.746870 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-51fddb56-7dc9-464a-ab5d-ec28d60c04f7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:35.747872 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-51fddb56-7dc9-464a-ab5d-ec28d60c04f7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:35.754132 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-51fddb56-7dc9-464a-ab5d-ec28d60c04f7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:35.754568 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-51fddb56-7dc9-464a-ab5d-ec28d60c04f7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:35.756017 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-51fddb56-7dc9-464a-ab5d-ec28d60c04f7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:35.756622 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-51fddb56-7dc9-464a-ab5d-ec28d60c04f7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:35.786452 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-51fddb56-7dc9-464a-ab5d-ec28d60c04f7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043415 May 26 15:15:35.787022 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 328/621] 10.222.0.45 () {60 vars in 1342 bytes} [Thu May 26 15:15:35 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:15:36.109810 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-987351cd-f061-449f-b397-eb545d026f40 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:36.110584 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-987351cd-f061-449f-b397-eb545d026f40 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 819b82d5-9c2d-4302-a0ad-ba9f20cac568] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:36.117540 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-987351cd-f061-449f-b397-eb545d026f40 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:36.117989 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-987351cd-f061-449f-b397-eb545d026f40 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:36.118768 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-987351cd-f061-449f-b397-eb545d026f40 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:36.119237 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-987351cd-f061-449f-b397-eb545d026f40 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:36.254678 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-987351cd-f061-449f-b397-eb545d026f40 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:36.257542 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:15:36.265125 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-987351cd-f061-449f-b397-eb545d026f40 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568" status: 200 len: 1366 microversion: 2.1 time: 0.159759 May 26 15:15:36.265623 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 294/622] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:36 2022] GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:36.475382 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-aa558da0-d270-4077-81f4-53284edb09b3 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:36.475997 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-aa558da0-d270-4077-81f4-53284edb09b3 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:36.483225 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-aa558da0-d270-4077-81f4-53284edb09b3 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:36.483705 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-aa558da0-d270-4077-81f4-53284edb09b3 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:36.484501 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-aa558da0-d270-4077-81f4-53284edb09b3 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:36.484938 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-aa558da0-d270-4077-81f4-53284edb09b3 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:36.622900 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-aa558da0-d270-4077-81f4-53284edb09b3 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:36.625091 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:15:36.633483 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-aa558da0-d270-4077-81f4-53284edb09b3 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1518 microversion: 2.1 time: 0.162143 May 26 15:15:36.634055 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 329/623] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:36 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:36.798995 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-393aa7b0-a2fa-4a34-923e-249ebe4a6d88 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:36.800086 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-393aa7b0-a2fa-4a34-923e-249ebe4a6d88 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:36.806568 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-393aa7b0-a2fa-4a34-923e-249ebe4a6d88 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:36.807014 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-393aa7b0-a2fa-4a34-923e-249ebe4a6d88 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:36.807819 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-393aa7b0-a2fa-4a34-923e-249ebe4a6d88 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:36.808251 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-393aa7b0-a2fa-4a34-923e-249ebe4a6d88 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:36.840126 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-393aa7b0-a2fa-4a34-923e-249ebe4a6d88 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045631 May 26 15:15:36.840706 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 295/624] 10.222.0.45 () {60 vars in 1342 bytes} [Thu May 26 15:15:36 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:15:37.284614 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-0be10be6-5c29-4a9d-818e-9076f70a2a0e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:37.285209 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-0be10be6-5c29-4a9d-818e-9076f70a2a0e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 819b82d5-9c2d-4302-a0ad-ba9f20cac568] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:37.292717 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0be10be6-5c29-4a9d-818e-9076f70a2a0e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:37.293165 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0be10be6-5c29-4a9d-818e-9076f70a2a0e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:37.293938 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0be10be6-5c29-4a9d-818e-9076f70a2a0e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:37.294376 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0be10be6-5c29-4a9d-818e-9076f70a2a0e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:37.430580 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-0be10be6-5c29-4a9d-818e-9076f70a2a0e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:37.438128 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-0be10be6-5c29-4a9d-818e-9076f70a2a0e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568" status: 200 len: 1366 microversion: 2.1 time: 0.159048 May 26 15:15:37.438699 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 330/625] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:37 2022] GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:15:37.651699 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e47efe43-7426-4549-bdfe-251d0f9a39cb tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:37.652304 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e47efe43-7426-4549-bdfe-251d0f9a39cb tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:37.658996 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e47efe43-7426-4549-bdfe-251d0f9a39cb tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:37.659547 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e47efe43-7426-4549-bdfe-251d0f9a39cb tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:37.660312 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e47efe43-7426-4549-bdfe-251d0f9a39cb tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:37.660747 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e47efe43-7426-4549-bdfe-251d0f9a39cb tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:37.809977 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e47efe43-7426-4549-bdfe-251d0f9a39cb tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:37.819189 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e47efe43-7426-4549-bdfe-251d0f9a39cb tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1518 microversion: 2.1 time: 0.170776 May 26 15:15:37.819774 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 296/626] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:37 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1518 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:37.852572 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-fa472af0-f50d-4d2d-9e98-ce9c584612a6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:37.853453 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-fa472af0-f50d-4d2d-9e98-ce9c584612a6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:37.860069 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fa472af0-f50d-4d2d-9e98-ce9c584612a6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:37.860519 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fa472af0-f50d-4d2d-9e98-ce9c584612a6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:37.861287 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fa472af0-f50d-4d2d-9e98-ce9c584612a6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:37.861750 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fa472af0-f50d-4d2d-9e98-ce9c584612a6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:37.893712 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-fa472af0-f50d-4d2d-9e98-ce9c584612a6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045571 May 26 15:15:37.894755 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 331/627] 10.222.0.45 () {60 vars in 1342 bytes} [Thu May 26 15:15:37 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:37.955998 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ea11dde0-a268-4dba-ac44-7a922bf55c5b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:37.956430 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ea11dde0-a268-4dba-ac44-7a922bf55c5b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:37.963203 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ea11dde0-a268-4dba-ac44-7a922bf55c5b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:37.963644 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ea11dde0-a268-4dba-ac44-7a922bf55c5b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:37.964409 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ea11dde0-a268-4dba-ac44-7a922bf55c5b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:37.964831 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ea11dde0-a268-4dba-ac44-7a922bf55c5b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:37.993447 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ea11dde0-a268-4dba-ac44-7a922bf55c5b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Going to try to terminate instance {{(pid=117798) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:15:38.077993 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ea11dde0-a268-4dba-ac44-7a922bf55c5b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 204 len: 0 microversion: 2.20 time: 0.125673 May 26 15:15:38.078595 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 297/628] 10.222.0.45 () {60 vars in 1279 bytes} [Thu May 26 15:15:37 2022] DELETE /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 15:15:38.087542 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-5b663833-a51c-4e64-848b-de3383aec58a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:38.088148 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-5b663833-a51c-4e64-848b-de3383aec58a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:38.094242 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5b663833-a51c-4e64-848b-de3383aec58a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:38.094696 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5b663833-a51c-4e64-848b-de3383aec58a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:38.095471 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5b663833-a51c-4e64-848b-de3383aec58a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:38.095895 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5b663833-a51c-4e64-848b-de3383aec58a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:38.247188 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-5b663833-a51c-4e64-848b-de3383aec58a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:38.255983 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-5b663833-a51c-4e64-848b-de3383aec58a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:38.257525 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-5b663833-a51c-4e64-848b-de3383aec58a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:38.258722 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-5b663833-a51c-4e64-848b-de3383aec58a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1723 microversion: 2.20 time: 0.175861 May 26 15:15:38.259307 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 332/629] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:15:38 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:15:38.456264 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-03ce71d2-be67-4c18-ac5f-0630828fa3cc tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:38.456961 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-03ce71d2-be67-4c18-ac5f-0630828fa3cc tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 819b82d5-9c2d-4302-a0ad-ba9f20cac568] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:38.463542 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-03ce71d2-be67-4c18-ac5f-0630828fa3cc tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:38.463989 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-03ce71d2-be67-4c18-ac5f-0630828fa3cc tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:38.464763 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-03ce71d2-be67-4c18-ac5f-0630828fa3cc tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:38.465388 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-03ce71d2-be67-4c18-ac5f-0630828fa3cc tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:38.606704 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-03ce71d2-be67-4c18-ac5f-0630828fa3cc tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:38.614399 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-03ce71d2-be67-4c18-ac5f-0630828fa3cc tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568" status: 200 len: 1557 microversion: 2.1 time: 0.162363 May 26 15:15:38.614399 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 298/630] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:38 2022] GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568 => generated 1557 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:38.631405 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-ba97e8ed-fd87-477a-875d-6ea34c7fae2b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:38.631935 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-ba97e8ed-fd87-477a-875d-6ea34c7fae2b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 819b82d5-9c2d-4302-a0ad-ba9f20cac568] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:38.638524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ba97e8ed-fd87-477a-875d-6ea34c7fae2b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:38.638970 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ba97e8ed-fd87-477a-875d-6ea34c7fae2b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:38.639767 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ba97e8ed-fd87-477a-875d-6ea34c7fae2b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:38.640203 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ba97e8ed-fd87-477a-875d-6ea34c7fae2b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:38.720486 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-ba97e8ed-fd87-477a-875d-6ea34c7fae2b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093578 May 26 15:15:38.721111 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 333/631] 10.222.0.45 () {58 vars in 1274 bytes} [Thu May 26 15:15:38 2022] GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:15:38.835811 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-2618a670-c03f-4d2f-bc54-c271cf0cbf23 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:38.837090 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-2618a670-c03f-4d2f-bc54-c271cf0cbf23 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:38.843668 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2618a670-c03f-4d2f-bc54-c271cf0cbf23 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:38.844115 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2618a670-c03f-4d2f-bc54-c271cf0cbf23 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:38.846385 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2618a670-c03f-4d2f-bc54-c271cf0cbf23 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:38.846385 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2618a670-c03f-4d2f-bc54-c271cf0cbf23 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:39.061853 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-e2055c79-4f93-4516-8994-39724b74107a req-0b304950-85dd-4779-94da-ba34fe4b22a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1f09bd-1e01-460e-be13-9b1749b27926", "name": "network-vif-unplugged", "status": "completed", "tag": "6a458fb5-32cd-48f8-8aa2-9f2629863eb3"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:15:39.074523 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-e2055c79-4f93-4516-8994-39724b74107a req-0b304950-85dd-4779-94da-ba34fe4b22a3 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:39.074965 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-e2055c79-4f93-4516-8994-39724b74107a req-0b304950-85dd-4779-94da-ba34fe4b22a3 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:39.089946 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.compute.server_external_events [req-e2055c79-4f93-4516-8994-39724b74107a req-0b304950-85dd-4779-94da-ba34fe4b22a3 service nova] Unable to find a host for instance 4e1f09bd-1e01-460e-be13-9b1749b27926. Dropping event network-vif-unplugged {{(pid=117799) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 26 15:15:39.091235 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-e2055c79-4f93-4516-8994-39724b74107a req-0b304950-85dd-4779-94da-ba34fe4b22a3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035495 May 26 15:15:39.092003 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 334/632] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 26 15:15:39.116466 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2618a670-c03f-4d2f-bc54-c271cf0cbf23 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:39.124319 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-2618a670-c03f-4d2f-bc54-c271cf0cbf23 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1518 microversion: 2.1 time: 0.292306 May 26 15:15:39.125220 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 299/633] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:38 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1518 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:39.278702 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-75d6df6e-6cbb-45e2-81cd-54ccb1344935 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:39.279332 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-75d6df6e-6cbb-45e2-81cd-54ccb1344935 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:39.285449 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-75d6df6e-6cbb-45e2-81cd-54ccb1344935 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:39.285907 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-75d6df6e-6cbb-45e2-81cd-54ccb1344935 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:39.286697 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-75d6df6e-6cbb-45e2-81cd-54ccb1344935 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:39.289997 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-75d6df6e-6cbb-45e2-81cd-54ccb1344935 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:39.544941 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-75d6df6e-6cbb-45e2-81cd-54ccb1344935 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:39.554691 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-75d6df6e-6cbb-45e2-81cd-54ccb1344935 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:39.556224 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-75d6df6e-6cbb-45e2-81cd-54ccb1344935 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:39.557390 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-75d6df6e-6cbb-45e2-81cd-54ccb1344935 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1723 microversion: 2.20 time: 0.282605 May 26 15:15:39.557945 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 335/634] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:15:39 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:15:39.859805 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-35e9d9f8-edee-4138-91ea-6863cd99d739 req-c4208d62-7412-4e9b-8d3b-95b3a3034780 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "819b82d5-9c2d-4302-a0ad-ba9f20cac568", "tag": "8b9cfb27-2ff7-44f9-80b9-917b08868d33"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:15:39.869377 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-35e9d9f8-edee-4138-91ea-6863cd99d739 req-c4208d62-7412-4e9b-8d3b-95b3a3034780 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:39.869815 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-35e9d9f8-edee-4138-91ea-6863cd99d739 req-c4208d62-7412-4e9b-8d3b-95b3a3034780 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:39.881872 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-35e9d9f8-edee-4138-91ea-6863cd99d739 req-c4208d62-7412-4e9b-8d3b-95b3a3034780 service nova] Creating event network-changed:8b9cfb27-2ff7-44f9-80b9-917b08868d33 for instance 819b82d5-9c2d-4302-a0ad-ba9f20cac568 on hv-cinder-84301 May 26 15:15:39.887077 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-35e9d9f8-edee-4138-91ea-6863cd99d739 req-c4208d62-7412-4e9b-8d3b-95b3a3034780 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030956 May 26 15:15:39.887706 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 300/635] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:15:40.142855 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-cd420717-462c-4043-bf40-f0575dcfc857 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:40.143441 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-cd420717-462c-4043-bf40-f0575dcfc857 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:40.151179 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-cd420717-462c-4043-bf40-f0575dcfc857 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:40.151623 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-cd420717-462c-4043-bf40-f0575dcfc857 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:40.152390 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-cd420717-462c-4043-bf40-f0575dcfc857 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:40.152817 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-cd420717-462c-4043-bf40-f0575dcfc857 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:40.304638 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-cd420717-462c-4043-bf40-f0575dcfc857 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:40.312763 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-cd420717-462c-4043-bf40-f0575dcfc857 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1518 microversion: 2.1 time: 0.173745 May 26 15:15:40.313355 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 336/636] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:40 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1518 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:40.586628 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-fc54d874-b7bb-4275-8f4a-bf70509122db tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:40.588346 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-fc54d874-b7bb-4275-8f4a-bf70509122db tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:40.599108 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fc54d874-b7bb-4275-8f4a-bf70509122db tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:40.601222 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fc54d874-b7bb-4275-8f4a-bf70509122db tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:40.602158 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fc54d874-b7bb-4275-8f4a-bf70509122db tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:40.602702 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fc54d874-b7bb-4275-8f4a-bf70509122db tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:40.761703 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-fc54d874-b7bb-4275-8f4a-bf70509122db tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:40.772304 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-fc54d874-b7bb-4275-8f4a-bf70509122db tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:40.773863 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-fc54d874-b7bb-4275-8f4a-bf70509122db tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:40.775240 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-fc54d874-b7bb-4275-8f4a-bf70509122db tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1723 microversion: 2.20 time: 0.202444 May 26 15:15:40.776480 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 301/637] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:15:40 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:15:41.329975 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-194f3d42-fa19-4fe2-9dc1-9a57b2697c96 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:41.330589 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-194f3d42-fa19-4fe2-9dc1-9a57b2697c96 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:41.338022 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-194f3d42-fa19-4fe2-9dc1-9a57b2697c96 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:41.338467 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-194f3d42-fa19-4fe2-9dc1-9a57b2697c96 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:41.339256 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-194f3d42-fa19-4fe2-9dc1-9a57b2697c96 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:41.339689 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-194f3d42-fa19-4fe2-9dc1-9a57b2697c96 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:41.473855 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-194f3d42-fa19-4fe2-9dc1-9a57b2697c96 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:41.481456 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-194f3d42-fa19-4fe2-9dc1-9a57b2697c96 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1574 microversion: 2.1 time: 0.155421 May 26 15:15:41.482035 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 337/638] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:41 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:15:41.800466 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-24a7758a-ac34-4b9c-87d3-86f1c8a7ec4a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:41.801059 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-24a7758a-ac34-4b9c-87d3-86f1c8a7ec4a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:41.808078 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:15:41.813792 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-24a7758a-ac34-4b9c-87d3-86f1c8a7ec4a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:41.814653 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-24a7758a-ac34-4b9c-87d3-86f1c8a7ec4a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:41.815485 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-24a7758a-ac34-4b9c-87d3-86f1c8a7ec4a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:41.815913 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-24a7758a-ac34-4b9c-87d3-86f1c8a7ec4a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:41.961652 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-24a7758a-ac34-4b9c-87d3-86f1c8a7ec4a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:41.970000 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-24a7758a-ac34-4b9c-87d3-86f1c8a7ec4a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:41.971654 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-24a7758a-ac34-4b9c-87d3-86f1c8a7ec4a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:41.972942 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-24a7758a-ac34-4b9c-87d3-86f1c8a7ec4a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1723 microversion: 2.20 time: 0.178282 May 26 15:15:41.974045 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 302/639] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:15:41 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:15:42.499128 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-77fa94c3-ffc2-4378-8b49-2ae91e335f00 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:42.499871 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-77fa94c3-ffc2-4378-8b49-2ae91e335f00 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:42.511668 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-77fa94c3-ffc2-4378-8b49-2ae91e335f00 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:42.512861 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-77fa94c3-ffc2-4378-8b49-2ae91e335f00 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:42.513755 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-77fa94c3-ffc2-4378-8b49-2ae91e335f00 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:42.514929 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-77fa94c3-ffc2-4378-8b49-2ae91e335f00 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:42.668214 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-77fa94c3-ffc2-4378-8b49-2ae91e335f00 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:42.676305 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-77fa94c3-ffc2-4378-8b49-2ae91e335f00 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1574 microversion: 2.1 time: 0.181198 May 26 15:15:42.677883 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 338/640] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:42 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1574 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:42.963135 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-4bccaca0-827d-4c69-8e14-5f4f2bb7188a req-23b05113-9e37-4715-a028-5d7fd7711fec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6", "name": "network-vif-deleted", "tag": "6342ec5c-6f4f-42ae-aaeb-2f79c05fef02"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:15:42.972590 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-4bccaca0-827d-4c69-8e14-5f4f2bb7188a req-23b05113-9e37-4715-a028-5d7fd7711fec service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:42.973505 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-4bccaca0-827d-4c69-8e14-5f4f2bb7188a req-23b05113-9e37-4715-a028-5d7fd7711fec service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:42.986450 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-4bccaca0-827d-4c69-8e14-5f4f2bb7188a req-23b05113-9e37-4715-a028-5d7fd7711fec service nova] Creating event network-vif-deleted:6342ec5c-6f4f-42ae-aaeb-2f79c05fef02 for instance 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 on hv-cinder-84301 May 26 15:15:42.995237 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-4bccaca0-827d-4c69-8e14-5f4f2bb7188a req-23b05113-9e37-4715-a028-5d7fd7711fec service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035697 May 26 15:15:42.998695 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-73c8cd34-e1c2-4a84-880a-c8873b7556da tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:42.998866 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 303/641] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:15:42.999460 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-73c8cd34-e1c2-4a84-880a-c8873b7556da tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:43.005716 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-73c8cd34-e1c2-4a84-880a-c8873b7556da tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:43.006239 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-73c8cd34-e1c2-4a84-880a-c8873b7556da tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:43.007187 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-73c8cd34-e1c2-4a84-880a-c8873b7556da tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:43.007833 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-73c8cd34-e1c2-4a84-880a-c8873b7556da tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:43.081766 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-73c8cd34-e1c2-4a84-880a-c8873b7556da tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:43.089323 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-73c8cd34-e1c2-4a84-880a-c8873b7556da tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:43.090810 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-73c8cd34-e1c2-4a84-880a-c8873b7556da tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:43.091988 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-73c8cd34-e1c2-4a84-880a-c8873b7556da tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1655 microversion: 2.20 time: 0.097804 May 26 15:15:43.092548 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 339/642] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:15:42 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1655 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:15:43.695043 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-2ed82086-afee-419c-9123-5916c3bb2957 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:43.695873 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-2ed82086-afee-419c-9123-5916c3bb2957 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:43.702347 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2ed82086-afee-419c-9123-5916c3bb2957 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:43.702792 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2ed82086-afee-419c-9123-5916c3bb2957 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:43.703613 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2ed82086-afee-419c-9123-5916c3bb2957 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:43.704022 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2ed82086-afee-419c-9123-5916c3bb2957 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:43.858703 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2ed82086-afee-419c-9123-5916c3bb2957 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:43.867230 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-2ed82086-afee-419c-9123-5916c3bb2957 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1574 microversion: 2.1 time: 0.176510 May 26 15:15:43.867657 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 304/643] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:43 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1574 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:15:44.111166 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-7c8b1454-5caa-4467-9216-d6c7e17fd002 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:44.111986 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-7c8b1454-5caa-4467-9216-d6c7e17fd002 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:44.118412 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7c8b1454-5caa-4467-9216-d6c7e17fd002 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:44.118857 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7c8b1454-5caa-4467-9216-d6c7e17fd002 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:44.119662 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7c8b1454-5caa-4467-9216-d6c7e17fd002 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:44.120096 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7c8b1454-5caa-4467-9216-d6c7e17fd002 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:44.153397 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7c8b1454-5caa-4467-9216-d6c7e17fd002 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:44.153840 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7c8b1454-5caa-4467-9216-d6c7e17fd002 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:44.154291 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.objects.instance [None req-7c8b1454-5caa-4467-9216-d6c7e17fd002 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lazy-loading 'fault' on Instance uuid 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 {{(pid=117799) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:15:44.195732 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-7c8b1454-5caa-4467-9216-d6c7e17fd002 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:44.203890 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-7c8b1454-5caa-4467-9216-d6c7e17fd002 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:44.205399 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-7c8b1454-5caa-4467-9216-d6c7e17fd002 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:44.206555 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-7c8b1454-5caa-4467-9216-d6c7e17fd002 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1370 microversion: 2.20 time: 0.099536 May 26 15:15:44.207168 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 340/644] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:15:44 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1370 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:15:44.884901 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-8d333083-ac49-4fd4-8bcd-24695c91603c tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:44.885648 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-8d333083-ac49-4fd4-8bcd-24695c91603c tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:44.892691 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8d333083-ac49-4fd4-8bcd-24695c91603c tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:44.893138 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8d333083-ac49-4fd4-8bcd-24695c91603c tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:44.894169 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8d333083-ac49-4fd4-8bcd-24695c91603c tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:44.894622 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8d333083-ac49-4fd4-8bcd-24695c91603c tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:45.039003 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-8d333083-ac49-4fd4-8bcd-24695c91603c tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:45.046717 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-8d333083-ac49-4fd4-8bcd-24695c91603c tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1574 microversion: 2.1 time: 0.165866 May 26 15:15:45.047320 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 305/645] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:44 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:45.225950 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-516970cc-8338-4eb5-8be5-2aec339e9cc3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:45.226570 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-516970cc-8338-4eb5-8be5-2aec339e9cc3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:45.233595 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-516970cc-8338-4eb5-8be5-2aec339e9cc3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:45.234040 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-516970cc-8338-4eb5-8be5-2aec339e9cc3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:45.234839 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-516970cc-8338-4eb5-8be5-2aec339e9cc3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:45.235260 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-516970cc-8338-4eb5-8be5-2aec339e9cc3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:45.272959 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-516970cc-8338-4eb5-8be5-2aec339e9cc3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:45.273425 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-516970cc-8338-4eb5-8be5-2aec339e9cc3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:45.274034 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.objects.instance [None req-516970cc-8338-4eb5-8be5-2aec339e9cc3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lazy-loading 'fault' on Instance uuid 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 {{(pid=117799) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:15:45.315937 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-516970cc-8338-4eb5-8be5-2aec339e9cc3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:45.325460 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-516970cc-8338-4eb5-8be5-2aec339e9cc3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:45.326965 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-516970cc-8338-4eb5-8be5-2aec339e9cc3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:45.328152 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-516970cc-8338-4eb5-8be5-2aec339e9cc3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 200 len: 1370 microversion: 2.20 time: 0.106149 May 26 15:15:45.328720 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 341/646] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:15:45 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 1370 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:15:46.064623 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-5c8c208c-ad6a-4ee8-b2f0-badcd50b28a7 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:46.065332 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-5c8c208c-ad6a-4ee8-b2f0-badcd50b28a7 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:46.072017 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5c8c208c-ad6a-4ee8-b2f0-badcd50b28a7 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:46.072454 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5c8c208c-ad6a-4ee8-b2f0-badcd50b28a7 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:46.073214 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5c8c208c-ad6a-4ee8-b2f0-badcd50b28a7 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:46.073638 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5c8c208c-ad6a-4ee8-b2f0-badcd50b28a7 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:46.208719 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-5c8c208c-ad6a-4ee8-b2f0-badcd50b28a7 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:46.217968 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-5c8c208c-ad6a-4ee8-b2f0-badcd50b28a7 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1574 microversion: 2.1 time: 0.157247 May 26 15:15:46.218559 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 306/647] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:46 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:46.346045 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-c2788ae2-a528-4dae-96ab-e8f1def62218 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:46.346594 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-c2788ae2-a528-4dae-96ab-e8f1def62218 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:46.353716 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c2788ae2-a528-4dae-96ab-e8f1def62218 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:46.354158 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c2788ae2-a528-4dae-96ab-e8f1def62218 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:46.354988 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c2788ae2-a528-4dae-96ab-e8f1def62218 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:46.355417 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c2788ae2-a528-4dae-96ab-e8f1def62218 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:46.369801 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.wsgi [None req-c2788ae2-a528-4dae-96ab-e8f1def62218 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] HTTP exception thrown: Instance 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 could not be found. May 26 15:15:46.371483 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-c2788ae2-a528-4dae-96ab-e8f1def62218 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Request method failure captured: May 26 15:15:46.371483 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: request: GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 HTTP/1.1 May 26 15:15:46.371483 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept: application/json May 26 15:15:46.371483 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept-Encoding: identity May 26 15:15:46.371483 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Connection: close May 26 15:15:46.371483 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Length: 0 May 26 15:15:46.371483 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Type: application/json May 26 15:15:46.371483 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Host: 10.222.0.45 May 26 15:15:46.371483 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Openstack-System-Scope: None May 26 15:15:46.371483 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: User-Agent: python-urllib3/1.26.9 May 26 15:15:46.371483 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Auth-Token: gAAAAABij5gMVhaWEX4FQhWB7cxAll_mRIZulrKEb1-jv9NcQxjEkpyovpQvUb4aV0JB4IiboU_z62gmhWiu0kDHMzLoVEsSdanxwYqeh5mD-nscxoSx8Ri5L1PuvFc4pJ1fmmy69rhXu7wQagOOyT_Oemd_BLx6I2lQnjvIrhx21H_Td2HryCY May 26 15:15:46.371483 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Id: None May 26 15:15:46.371483 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Name: None May 26 15:15:46.371483 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Identity-Status: Confirmed May 26 15:15:46.371483 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Is-Admin-Project: True May 26 15:15:46.371483 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Openstack-Nova-Api-Version: 2.20 May 26 15:15:46.371483 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Id: default May 26 15:15:46.371483 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Name: Default May 26 15:15:46.371483 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Id: b9de893c8bbd47b59e136fe46e791a52 May 26 15:15:46.371483 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-267313914 May 26 15:15:46.371483 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Role: reader,member May 26 15:15:46.371483 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Roles: reader,member May 26 15:15:46.373105 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b9de893c8bbd47b59e136fe46e791a52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b9de893c8bbd47b59e136fe46e791a52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b9de893c8bbd47b59e136fe46e791a52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b9de893c8bbd47b59e136fe46e791a52"}]}] May 26 15:15:46.373105 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant: tempest-AttachVolumeShelveTestJSON-267313914 May 26 15:15:46.373105 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Id: b9de893c8bbd47b59e136fe46e791a52 May 26 15:15:46.373105 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-267313914 May 26 15:15:46.373105 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User: tempest-AttachVolumeShelveTestJSON-267313914-project May 26 15:15:46.373105 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Id: default May 26 15:15:46.373105 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Name: Default May 26 15:15:46.373105 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Id: 1748648695bb46a9b2c7912c48e95bbd May 26 15:15:46.373105 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Name: tempest-AttachVolumeShelveTestJSON-267313914-project May 26 15:15:46.373105 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: method: > May 26 15:15:46.373105 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: exception: Instance 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 could not be found. May 26 15:15:46.373105 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: action_args: {'id': '4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6'} May 26 15:15:46.374172 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:15:46.374172 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:46.374172 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:15:46.374172 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:15:46.374172 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:15:46.374172 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:15:46.374172 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:15:46.374172 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:15:46.374172 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:15:46.374172 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:15:46.374172 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 could not be found. May 26 15:15:46.374172 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:15:46.374172 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:15:46.374172 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:15:46.374172 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:46.374172 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:15:46.374172 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:15:46.374172 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:15:46.374172 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:15:46.374172 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:15:46.376805 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:15:46.376805 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:15:46.376805 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:15:46.376805 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:15:46.376805 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:15:46.376805 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:15:46.376805 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:15:46.376805 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 could not be found. May 26 15:15:46.376805 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:15:46.376805 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:15:46.376805 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:15:46.376805 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:46.376805 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:15:46.376805 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:15:46.376805 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:15:46.376805 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:15:46.376805 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 could not be found. May 26 15:15:46.376805 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:15:46.378128 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-c2788ae2-a528-4dae-96ab-e8f1def62218 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Returning 404 to user: Instance 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 could not be found. {{(pid=117799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:15:46.378128 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-c2788ae2-a528-4dae-96ab-e8f1def62218 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 404 len: 111 microversion: 2.20 time: 0.030926 May 26 15:15:46.378128 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 342/648] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:15:46 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 15:15:46.382588 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f5b2e507-1fa1-475b-99f8-77630cded051 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '.version_select at 0x7ffb5e5eb430>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:46.400346 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f5b2e507-1fa1-475b-99f8-77630cded051 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-649054502" status: 204 len: 0 microversion: 2.20 time: 0.022239 May 26 15:15:46.400925 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 307/649] 10.222.0.45 () {60 vars in 1258 bytes} [Thu May 26 15:15:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-649054502 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 15:15:47.079692 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-7010b6b9-ed5d-4f6a-852a-50c5a7cf723b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Action: 'create', calling method: .version_select at 0x7ffb5d6a4940>, body: {"keypair": {"name": "tempest-keypair-488125112", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOr6SlQFvVnyS4zyzpO+Fam8b8CqCAqxucNgkAlnIqN4I2Q2nqTWGZC+DfBlZjmxUcRy6itEw3nzd1YnbGJsnfb4O//UUU6pszT8Hg1/tMuLL9z6X9QbDMMMROWs9pTG0g=="}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:15:47.095229 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.quota [None req-7010b6b9-ed5d-4f6a-852a-50c5a7cf723b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Getting quotas for project b9de893c8bbd47b59e136fe46e791a52. Resources: {'key_pairs'} {{(pid=117799) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:15:47.099472 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.quota [None req-7010b6b9-ed5d-4f6a-852a-50c5a7cf723b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Getting quotas for user 1748648695bb46a9b2c7912c48e95bbd and project b9de893c8bbd47b59e136fe46e791a52. Resources: {'key_pairs'} {{(pid=117799) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:15:47.124621 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-7010b6b9-ed5d-4f6a-852a-50c5a7cf723b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.048814 May 26 15:15:47.125619 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 343/650] 10.222.0.45 () {62 vars in 1199 bytes} [Thu May 26 15:15:47 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 26 15:15:47.236094 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-95749a0a-a5f3-424b-af52-ed18f4666e36 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:47.237011 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-95749a0a-a5f3-424b-af52-ed18f4666e36 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:47.245374 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-95749a0a-a5f3-424b-af52-ed18f4666e36 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:47.246225 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-95749a0a-a5f3-424b-af52-ed18f4666e36 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:47.246969 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-95749a0a-a5f3-424b-af52-ed18f4666e36 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:47.247435 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-95749a0a-a5f3-424b-af52-ed18f4666e36 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:47.700390 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-95749a0a-a5f3-424b-af52-ed18f4666e36 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:47.709870 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-95749a0a-a5f3-424b-af52-ed18f4666e36 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1574 microversion: 2.1 time: 0.478454 May 26 15:15:47.720863 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 308/651] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:47 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1574 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:48.725498 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-05aee204-b1c6-4a20-be19-6e9669d7e3a3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1273767280", "imageRef": "5b5a68b4-38e3-4f05-b97f-4339d6752e34", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2ab2b37c-b216-46a4-aab4-9608db322f8a"}], "security_groups": [{"name": "tempest-securitygroup--1844870148"}], "key_name": "tempest-keypair-488125112", "user_data": "}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:15:48.727343 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d6891455-99f1-4b32-943f-cab0de039f1a tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:48.727960 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-d6891455-99f1-4b32-943f-cab0de039f1a tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:48.734518 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d6891455-99f1-4b32-943f-cab0de039f1a tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:48.734965 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d6891455-99f1-4b32-943f-cab0de039f1a tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:48.735774 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d6891455-99f1-4b32-943f-cab0de039f1a tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:48.736207 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d6891455-99f1-4b32-943f-cab0de039f1a tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:48.881866 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.network.neutron [None req-05aee204-b1c6-4a20-be19-6e9669d7e3a3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] validate_networks() for [('2ab2b37c-b216-46a4-aab4-9608db322f8a', None, None, None, None, None)] {{(pid=117799) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:15:48.937073 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d6891455-99f1-4b32-943f-cab0de039f1a tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:48.946134 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-d6891455-99f1-4b32-943f-cab0de039f1a tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1574 microversion: 2.1 time: 0.222787 May 26 15:15:48.947048 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 309/652] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:48 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1574 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:49.292566 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-05aee204-b1c6-4a20-be19-6e9669d7e3a3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Flavor limits 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:15:49.292996 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-05aee204-b1c6-4a20-be19-6e9669d7e3a3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Image limits 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:15:49.293476 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-05aee204-b1c6-4a20-be19-6e9669d7e3a3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Flavor pref 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:15:49.293889 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-05aee204-b1c6-4a20-be19-6e9669d7e3a3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Image pref 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:15:49.294943 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-05aee204-b1c6-4a20-be19-6e9669d7e3a3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:15:49.305370 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-05aee204-b1c6-4a20-be19-6e9669d7e3a3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:49.305818 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-05aee204-b1c6-4a20-be19-6e9669d7e3a3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:49.306635 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-05aee204-b1c6-4a20-be19-6e9669d7e3a3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:49.307291 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-05aee204-b1c6-4a20-be19-6e9669d7e3a3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:49.321828 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-a8d981ab-37ef-4477-a437-96b0072319a5 req-885489dd-be80-4447-8abb-079c8ac252d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1f09bd-1e01-460e-be13-9b1749b27926", "name": "network-vif-plugged", "status": "completed", "tag": "6a458fb5-32cd-48f8-8aa2-9f2629863eb3"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:15:49.329407 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.quota [None req-05aee204-b1c6-4a20-be19-6e9669d7e3a3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Getting quotas for project b9de893c8bbd47b59e136fe46e791a52. Resources: {'cores', 'ram', 'instances'} {{(pid=117799) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:15:49.332814 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-a8d981ab-37ef-4477-a437-96b0072319a5 req-885489dd-be80-4447-8abb-079c8ac252d7 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:49.333360 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-a8d981ab-37ef-4477-a437-96b0072319a5 req-885489dd-be80-4447-8abb-079c8ac252d7 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:49.339206 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.quota [None req-05aee204-b1c6-4a20-be19-6e9669d7e3a3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Getting quotas for user 1748648695bb46a9b2c7912c48e95bbd and project b9de893c8bbd47b59e136fe46e791a52. Resources: {'cores', 'ram', 'instances'} {{(pid=117799) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:15:49.346082 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-a8d981ab-37ef-4477-a437-96b0072319a5 req-885489dd-be80-4447-8abb-079c8ac252d7 service nova] Creating event network-vif-plugged:6a458fb5-32cd-48f8-8aa2-9f2629863eb3 for instance 4e1f09bd-1e01-460e-be13-9b1749b27926 on hv-cinder-84301 May 26 15:15:49.351790 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-05aee204-b1c6-4a20-be19-6e9669d7e3a3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Going to run 1 instances... {{(pid=117799) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:15:49.352714 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-a8d981ab-37ef-4477-a437-96b0072319a5 req-885489dd-be80-4447-8abb-079c8ac252d7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034687 May 26 15:15:49.353882 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 310/653] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:15:49.360225 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-05aee204-b1c6-4a20-be19-6e9669d7e3a3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5b5a68b4-38e3-4f05-b97f-4339d6752e34',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117799) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:15:49.415414 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-05aee204-b1c6-4a20-be19-6e9669d7e3a3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.694908 May 26 15:15:49.416062 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 344/654] 10.222.0.45 () {62 vars in 1187 bytes} [Thu May 26 15:15:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 26 15:15:49.430686 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f62e3356-570b-46d6-a978-32adccc981d1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:49.431413 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f62e3356-570b-46d6-a978-32adccc981d1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:49.488653 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f62e3356-570b-46d6-a978-32adccc981d1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:49.497083 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f62e3356-570b-46d6-a978-32adccc981d1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:49.498601 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f62e3356-570b-46d6-a978-32adccc981d1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:49.499746 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f62e3356-570b-46d6-a978-32adccc981d1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1281 microversion: 2.20 time: 0.074056 May 26 15:15:49.500791 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 311/655] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:15:49 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:15:49.963834 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-a2824dca-61ac-4d2b-af1e-4c6896f44535 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:49.964441 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-a2824dca-61ac-4d2b-af1e-4c6896f44535 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:49.971206 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a2824dca-61ac-4d2b-af1e-4c6896f44535 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:49.971648 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a2824dca-61ac-4d2b-af1e-4c6896f44535 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:49.973841 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a2824dca-61ac-4d2b-af1e-4c6896f44535 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:49.973841 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a2824dca-61ac-4d2b-af1e-4c6896f44535 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:50.113336 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-a2824dca-61ac-4d2b-af1e-4c6896f44535 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:50.123716 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-a2824dca-61ac-4d2b-af1e-4c6896f44535 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1574 microversion: 2.1 time: 0.163747 May 26 15:15:50.124307 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 345/656] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:49 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:50.518004 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c876b17e-d0da-4cc2-921f-dbe61fdf6fb0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:50.518928 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c876b17e-d0da-4cc2-921f-dbe61fdf6fb0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:50.528121 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c876b17e-d0da-4cc2-921f-dbe61fdf6fb0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:50.528562 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c876b17e-d0da-4cc2-921f-dbe61fdf6fb0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:50.529494 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c876b17e-d0da-4cc2-921f-dbe61fdf6fb0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:50.530086 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c876b17e-d0da-4cc2-921f-dbe61fdf6fb0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:50.606424 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c876b17e-d0da-4cc2-921f-dbe61fdf6fb0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:50.615325 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c876b17e-d0da-4cc2-921f-dbe61fdf6fb0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:50.616843 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c876b17e-d0da-4cc2-921f-dbe61fdf6fb0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:50.618010 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c876b17e-d0da-4cc2-921f-dbe61fdf6fb0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1333 microversion: 2.20 time: 0.104074 May 26 15:15:50.618571 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 312/657] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:15:50 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1333 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:15:51.141495 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-df46a2d7-d604-4c53-b203-5fb118e91be7 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:51.142126 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-df46a2d7-d604-4c53-b203-5fb118e91be7 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:51.149845 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-df46a2d7-d604-4c53-b203-5fb118e91be7 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:51.150292 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-df46a2d7-d604-4c53-b203-5fb118e91be7 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:51.151065 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-df46a2d7-d604-4c53-b203-5fb118e91be7 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:51.151533 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-df46a2d7-d604-4c53-b203-5fb118e91be7 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:51.292724 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-df46a2d7-d604-4c53-b203-5fb118e91be7 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:51.303858 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-df46a2d7-d604-4c53-b203-5fb118e91be7 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1574 microversion: 2.1 time: 0.166117 May 26 15:15:51.304509 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 346/658] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:51 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:51.636738 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-50191b49-28dc-4560-923e-8db68e896d88 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:51.637353 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-50191b49-28dc-4560-923e-8db68e896d88 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:51.644372 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-50191b49-28dc-4560-923e-8db68e896d88 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:51.644814 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-50191b49-28dc-4560-923e-8db68e896d88 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:51.645842 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-50191b49-28dc-4560-923e-8db68e896d88 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:51.646285 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-50191b49-28dc-4560-923e-8db68e896d88 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:51.716888 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-50191b49-28dc-4560-923e-8db68e896d88 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:51.719274 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:15:51.726499 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-50191b49-28dc-4560-923e-8db68e896d88 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:51.728039 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-50191b49-28dc-4560-923e-8db68e896d88 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:51.729241 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-50191b49-28dc-4560-923e-8db68e896d88 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1339 microversion: 2.20 time: 0.096589 May 26 15:15:51.732206 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 313/659] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:15:51 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1339 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:15:52.324985 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-ae35fe9c-2e41-4b50-adf4-0c9cc10f6abc tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:52.325894 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-ae35fe9c-2e41-4b50-adf4-0c9cc10f6abc tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:52.335412 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ae35fe9c-2e41-4b50-adf4-0c9cc10f6abc tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:52.335936 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ae35fe9c-2e41-4b50-adf4-0c9cc10f6abc tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:52.336727 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ae35fe9c-2e41-4b50-adf4-0c9cc10f6abc tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:52.337167 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ae35fe9c-2e41-4b50-adf4-0c9cc10f6abc tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:52.499330 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-ae35fe9c-2e41-4b50-adf4-0c9cc10f6abc tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:52.507931 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-ae35fe9c-2e41-4b50-adf4-0c9cc10f6abc tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1561 microversion: 2.1 time: 0.188342 May 26 15:15:52.508526 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 347/660] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:52 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1561 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:52.751898 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-6aa98367-eb59-4f78-8fc9-1fa336236d99 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:52.753202 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-6aa98367-eb59-4f78-8fc9-1fa336236d99 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:52.763371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6aa98367-eb59-4f78-8fc9-1fa336236d99 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:52.763902 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6aa98367-eb59-4f78-8fc9-1fa336236d99 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:52.764782 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6aa98367-eb59-4f78-8fc9-1fa336236d99 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:52.765414 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6aa98367-eb59-4f78-8fc9-1fa336236d99 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:52.920830 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6aa98367-eb59-4f78-8fc9-1fa336236d99 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:52.931666 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6aa98367-eb59-4f78-8fc9-1fa336236d99 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:52.933191 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6aa98367-eb59-4f78-8fc9-1fa336236d99 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:52.934328 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-6aa98367-eb59-4f78-8fc9-1fa336236d99 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1407 microversion: 2.20 time: 0.188232 May 26 15:15:52.934905 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 314/661] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:15:52 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:15:53.481958 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-c4cac333-1f7d-4fe8-850d-0df2a54a98d3 req-d1638ec9-6f69-420a-ba63-367a9b22b7d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d97e6323-aeef-4755-9bc5-93ae5140640b", "tag": "88cc91ef-0c85-4971-928d-0eb2739f6222"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:15:53.495682 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-c4cac333-1f7d-4fe8-850d-0df2a54a98d3 req-d1638ec9-6f69-420a-ba63-367a9b22b7d0 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:53.496825 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-c4cac333-1f7d-4fe8-850d-0df2a54a98d3 req-d1638ec9-6f69-420a-ba63-367a9b22b7d0 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:53.511346 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-c4cac333-1f7d-4fe8-850d-0df2a54a98d3 req-d1638ec9-6f69-420a-ba63-367a9b22b7d0 service nova] Creating event network-changed:88cc91ef-0c85-4971-928d-0eb2739f6222 for instance d97e6323-aeef-4755-9bc5-93ae5140640b on hv-cinder-84301 May 26 15:15:53.517863 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-c4cac333-1f7d-4fe8-850d-0df2a54a98d3 req-d1638ec9-6f69-420a-ba63-367a9b22b7d0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041054 May 26 15:15:53.518467 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 348/662] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:15:53.956153 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-28023911-a2b2-43e2-816f-7e56847b34d4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:53.957495 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-28023911-a2b2-43e2-816f-7e56847b34d4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:53.965478 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-28023911-a2b2-43e2-816f-7e56847b34d4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:53.965920 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-28023911-a2b2-43e2-816f-7e56847b34d4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:53.966693 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-28023911-a2b2-43e2-816f-7e56847b34d4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:53.967160 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-28023911-a2b2-43e2-816f-7e56847b34d4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:54.110604 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-28023911-a2b2-43e2-816f-7e56847b34d4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:54.119821 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-28023911-a2b2-43e2-816f-7e56847b34d4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:54.121355 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-28023911-a2b2-43e2-816f-7e56847b34d4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:54.122480 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-28023911-a2b2-43e2-816f-7e56847b34d4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1407 microversion: 2.20 time: 0.172285 May 26 15:15:54.123044 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 315/663] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:15:53 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:15:55.142918 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-2286b200-bf0d-45a4-8c49-ef3650eae882 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:55.143982 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-2286b200-bf0d-45a4-8c49-ef3650eae882 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:55.150717 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2286b200-bf0d-45a4-8c49-ef3650eae882 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:55.151189 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2286b200-bf0d-45a4-8c49-ef3650eae882 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:55.151994 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2286b200-bf0d-45a4-8c49-ef3650eae882 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:55.152426 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2286b200-bf0d-45a4-8c49-ef3650eae882 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:55.286880 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-2286b200-bf0d-45a4-8c49-ef3650eae882 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:55.289248 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=100 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:15:55.296334 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-2286b200-bf0d-45a4-8c49-ef3650eae882 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:55.297875 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-2286b200-bf0d-45a4-8c49-ef3650eae882 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:55.299237 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-2286b200-bf0d-45a4-8c49-ef3650eae882 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1407 microversion: 2.20 time: 0.161029 May 26 15:15:55.299931 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 349/664] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:15:55 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:15:56.322818 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e63cd9ad-d48e-4874-98fc-bff641a261dc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:56.323458 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e63cd9ad-d48e-4874-98fc-bff641a261dc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:56.330209 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e63cd9ad-d48e-4874-98fc-bff641a261dc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:56.330684 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e63cd9ad-d48e-4874-98fc-bff641a261dc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:56.331519 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e63cd9ad-d48e-4874-98fc-bff641a261dc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:56.331958 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e63cd9ad-d48e-4874-98fc-bff641a261dc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:56.478486 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e63cd9ad-d48e-4874-98fc-bff641a261dc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:56.486359 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e63cd9ad-d48e-4874-98fc-bff641a261dc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:56.487927 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e63cd9ad-d48e-4874-98fc-bff641a261dc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:56.490228 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e63cd9ad-d48e-4874-98fc-bff641a261dc tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1407 microversion: 2.20 time: 0.170903 May 26 15:15:56.490806 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 316/665] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:15:56 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:15:56.725915 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-2e6fb45d-4790-480c-90c1-b8ac98ba56ef tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:56.726496 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-2e6fb45d-4790-480c-90c1-b8ac98ba56ef tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:56.733384 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2e6fb45d-4790-480c-90c1-b8ac98ba56ef tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:56.733831 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2e6fb45d-4790-480c-90c1-b8ac98ba56ef tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:56.734601 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2e6fb45d-4790-480c-90c1-b8ac98ba56ef tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:56.735028 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2e6fb45d-4790-480c-90c1-b8ac98ba56ef tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:56.861751 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.objects.instance [None req-2e6fb45d-4790-480c-90c1-b8ac98ba56ef tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lazy-loading 'services' on Instance uuid b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b {{(pid=117799) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:15:56.985064 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-2e6fb45d-4790-480c-90c1-b8ac98ba56ef tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b/os-volume_attachments/379451d7-a770-42a0-993a-d1c20a7a8f27" status: 202 len: 0 microversion: 2.1 time: 0.262968 May 26 15:15:56.985830 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 350/666] 10.222.0.45 () {58 vars in 1415 bytes} [Thu May 26 15:15:56 2022] DELETE /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b/os-volume_attachments/379451d7-a770-42a0-993a-d1c20a7a8f27 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:15:56.995977 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-bd99ac40-5c7f-4e94-94f6-be2bba642a11 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:56.997209 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-bd99ac40-5c7f-4e94-94f6-be2bba642a11 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:57.003587 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bd99ac40-5c7f-4e94-94f6-be2bba642a11 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:57.004034 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bd99ac40-5c7f-4e94-94f6-be2bba642a11 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:57.004819 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bd99ac40-5c7f-4e94-94f6-be2bba642a11 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:57.005249 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bd99ac40-5c7f-4e94-94f6-be2bba642a11 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:57.036780 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-bd99ac40-5c7f-4e94-94f6-be2bba642a11 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045523 May 26 15:15:57.037363 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 317/667] 10.222.0.45 () {58 vars in 1301 bytes} [Thu May 26 15:15:56 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:15:57.509626 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-f37da738-d456-4c36-90a4-94b950dc4544 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:57.510280 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-f37da738-d456-4c36-90a4-94b950dc4544 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:57.518203 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f37da738-d456-4c36-90a4-94b950dc4544 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:57.520957 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f37da738-d456-4c36-90a4-94b950dc4544 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:57.522716 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f37da738-d456-4c36-90a4-94b950dc4544 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:57.523273 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f37da738-d456-4c36-90a4-94b950dc4544 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:57.668121 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-f37da738-d456-4c36-90a4-94b950dc4544 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:57.677130 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-f37da738-d456-4c36-90a4-94b950dc4544 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:57.678633 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-f37da738-d456-4c36-90a4-94b950dc4544 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:57.679806 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-f37da738-d456-4c36-90a4-94b950dc4544 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1407 microversion: 2.20 time: 0.175458 May 26 15:15:57.680365 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 351/668] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:15:57 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:15:58.049884 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-cf6f5e2e-8746-4f43-8150-a66654145963 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:58.050817 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-cf6f5e2e-8746-4f43-8150-a66654145963 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:58.057607 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cf6f5e2e-8746-4f43-8150-a66654145963 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:58.058054 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cf6f5e2e-8746-4f43-8150-a66654145963 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:58.058825 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cf6f5e2e-8746-4f43-8150-a66654145963 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:58.059290 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cf6f5e2e-8746-4f43-8150-a66654145963 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:58.094964 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-cf6f5e2e-8746-4f43-8150-a66654145963 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049071 May 26 15:15:58.095618 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 318/669] 10.222.0.45 () {58 vars in 1301 bytes} [Thu May 26 15:15:58 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:15:58.699064 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-44074765-fb44-4454-a7d5-c704462eb5cb tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:58.699635 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-44074765-fb44-4454-a7d5-c704462eb5cb tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:58.705864 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-44074765-fb44-4454-a7d5-c704462eb5cb tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:58.706309 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-44074765-fb44-4454-a7d5-c704462eb5cb tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:58.707061 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-44074765-fb44-4454-a7d5-c704462eb5cb tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:58.707578 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-44074765-fb44-4454-a7d5-c704462eb5cb tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:58.836223 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-44074765-fb44-4454-a7d5-c704462eb5cb tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:58.844149 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-44074765-fb44-4454-a7d5-c704462eb5cb tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:58.845679 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-44074765-fb44-4454-a7d5-c704462eb5cb tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:58.846778 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-44074765-fb44-4454-a7d5-c704462eb5cb tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1407 microversion: 2.20 time: 0.151910 May 26 15:15:58.847373 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 352/670] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:15:58 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:15:59.107429 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e7395279-e72e-48d7-9df2-be652a9f577a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:59.108355 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e7395279-e72e-48d7-9df2-be652a9f577a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:59.117473 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e7395279-e72e-48d7-9df2-be652a9f577a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:59.117923 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e7395279-e72e-48d7-9df2-be652a9f577a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:59.118695 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e7395279-e72e-48d7-9df2-be652a9f577a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:59.119164 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e7395279-e72e-48d7-9df2-be652a9f577a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:59.149337 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e7395279-e72e-48d7-9df2-be652a9f577a tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045897 May 26 15:15:59.149912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 319/671] 10.222.0.45 () {58 vars in 1301 bytes} [Thu May 26 15:15:59 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 15:15:59.236303 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-78b6a7d2-99cc-4899-8fda-be4ae626bd44 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:59.236864 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-78b6a7d2-99cc-4899-8fda-be4ae626bd44 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:59.244817 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-78b6a7d2-99cc-4899-8fda-be4ae626bd44 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:59.245361 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-78b6a7d2-99cc-4899-8fda-be4ae626bd44 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:59.246128 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-78b6a7d2-99cc-4899-8fda-be4ae626bd44 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:59.246559 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-78b6a7d2-99cc-4899-8fda-be4ae626bd44 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:59.275049 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-78b6a7d2-99cc-4899-8fda-be4ae626bd44 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Going to try to terminate instance {{(pid=117799) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:15:59.315413 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell0:SELECT=2 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:15:59.348496 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell0:SELECT=10 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:15:59.371619 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-78b6a7d2-99cc-4899-8fda-be4ae626bd44 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 204 len: 0 microversion: 2.1 time: 0.147993 May 26 15:15:59.372677 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 353/672] 10.222.0.45 () {58 vars in 1238 bytes} [Thu May 26 15:15:59 2022] DELETE /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:15:59.381516 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-4a205420-7cf3-48da-af92-9ede03eabace tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:59.382161 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-4a205420-7cf3-48da-af92-9ede03eabace tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:59.388887 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4a205420-7cf3-48da-af92-9ede03eabace tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:59.389483 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4a205420-7cf3-48da-af92-9ede03eabace tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:59.390394 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4a205420-7cf3-48da-af92-9ede03eabace tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:59.391150 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4a205420-7cf3-48da-af92-9ede03eabace tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:59.493615 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=2 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:15:59.534000 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-4a205420-7cf3-48da-af92-9ede03eabace tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:59.542052 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-4a205420-7cf3-48da-af92-9ede03eabace tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1690 microversion: 2.1 time: 0.165201 May 26 15:15:59.542856 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 320/673] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:15:59 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:59.866408 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-cca58fe8-e538-4055-8355-cc278da43ecf tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:59.867126 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-cca58fe8-e538-4055-8355-cc278da43ecf tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:59.869536 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:15:59.875347 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-cca58fe8-e538-4055-8355-cc278da43ecf tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:59.875958 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-cca58fe8-e538-4055-8355-cc278da43ecf tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:59.876730 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-cca58fe8-e538-4055-8355-cc278da43ecf tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:59.877166 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-cca58fe8-e538-4055-8355-cc278da43ecf tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:00.012631 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-cca58fe8-e538-4055-8355-cc278da43ecf tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:00.020865 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-cca58fe8-e538-4055-8355-cc278da43ecf tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:00.022362 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-cca58fe8-e538-4055-8355-cc278da43ecf tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:00.023516 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-cca58fe8-e538-4055-8355-cc278da43ecf tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1407 microversion: 2.20 time: 0.162363 May 26 15:16:00.024077 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 354/674] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:15:59 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:16:00.559510 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c9b92875-d456-468d-a335-2efebcb13419 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:00.560102 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c9b92875-d456-468d-a335-2efebcb13419 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:00.567451 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c9b92875-d456-468d-a335-2efebcb13419 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:00.567897 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c9b92875-d456-468d-a335-2efebcb13419 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:00.568671 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c9b92875-d456-468d-a335-2efebcb13419 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:00.569103 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c9b92875-d456-468d-a335-2efebcb13419 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:00.702948 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c9b92875-d456-468d-a335-2efebcb13419 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:00.711534 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c9b92875-d456-468d-a335-2efebcb13419 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1690 microversion: 2.1 time: 0.155768 May 26 15:16:00.712043 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 321/675] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:16:00 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:16:01.042219 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-fcf28f93-6b0f-43c7-86a7-8e15ec5cb712 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:01.042909 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-fcf28f93-6b0f-43c7-86a7-8e15ec5cb712 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:01.049344 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fcf28f93-6b0f-43c7-86a7-8e15ec5cb712 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:01.049791 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fcf28f93-6b0f-43c7-86a7-8e15ec5cb712 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:01.050552 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fcf28f93-6b0f-43c7-86a7-8e15ec5cb712 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:01.050992 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fcf28f93-6b0f-43c7-86a7-8e15ec5cb712 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:01.181942 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-fcf28f93-6b0f-43c7-86a7-8e15ec5cb712 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:01.190010 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-fcf28f93-6b0f-43c7-86a7-8e15ec5cb712 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:01.191530 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-fcf28f93-6b0f-43c7-86a7-8e15ec5cb712 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:01.193931 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-fcf28f93-6b0f-43c7-86a7-8e15ec5cb712 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1407 microversion: 2.20 time: 0.155583 May 26 15:16:01.194503 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 355/676] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:16:01 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:16:01.704887 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-02dc9647-0bfe-4154-8557-f26899f60c09 req-c98f79f6-baba-48c0-85ec-5a38abe0cba7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d97e6323-aeef-4755-9bc5-93ae5140640b", "name": "network-vif-plugged", "status": "completed", "tag": "88cc91ef-0c85-4971-928d-0eb2739f6222"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:16:01.714798 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-02dc9647-0bfe-4154-8557-f26899f60c09 req-c98f79f6-baba-48c0-85ec-5a38abe0cba7 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:01.715252 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-02dc9647-0bfe-4154-8557-f26899f60c09 req-c98f79f6-baba-48c0-85ec-5a38abe0cba7 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:01.727165 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-02dc9647-0bfe-4154-8557-f26899f60c09 req-c98f79f6-baba-48c0-85ec-5a38abe0cba7 service nova] Creating event network-vif-plugged:88cc91ef-0c85-4971-928d-0eb2739f6222 for instance d97e6323-aeef-4755-9bc5-93ae5140640b on hv-cinder-84301 May 26 15:16:01.728860 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-643b78f4-ae36-4c4c-bb64-322dcd38b5fd tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:01.729537 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-643b78f4-ae36-4c4c-bb64-322dcd38b5fd tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:01.732450 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-02dc9647-0bfe-4154-8557-f26899f60c09 req-c98f79f6-baba-48c0-85ec-5a38abe0cba7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031139 May 26 15:16:01.733056 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 322/677] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:16:01.736187 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-643b78f4-ae36-4c4c-bb64-322dcd38b5fd tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:01.736663 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-643b78f4-ae36-4c4c-bb64-322dcd38b5fd tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:01.737424 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-643b78f4-ae36-4c4c-bb64-322dcd38b5fd tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:01.737852 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-643b78f4-ae36-4c4c-bb64-322dcd38b5fd tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:01.877184 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-643b78f4-ae36-4c4c-bb64-322dcd38b5fd tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:01.885522 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-643b78f4-ae36-4c4c-bb64-322dcd38b5fd tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1690 microversion: 2.1 time: 0.160711 May 26 15:16:01.886105 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 356/678] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:16:01 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:16:02.212796 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-20605765-4bac-4f1d-8aef-4c8393fe3670 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:02.213399 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-20605765-4bac-4f1d-8aef-4c8393fe3670 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:02.219764 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-20605765-4bac-4f1d-8aef-4c8393fe3670 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:02.220214 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-20605765-4bac-4f1d-8aef-4c8393fe3670 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:02.220989 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-20605765-4bac-4f1d-8aef-4c8393fe3670 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:02.221427 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-20605765-4bac-4f1d-8aef-4c8393fe3670 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:02.362919 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-20605765-4bac-4f1d-8aef-4c8393fe3670 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:02.371896 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-20605765-4bac-4f1d-8aef-4c8393fe3670 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:02.373399 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-20605765-4bac-4f1d-8aef-4c8393fe3670 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:02.374503 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-20605765-4bac-4f1d-8aef-4c8393fe3670 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1407 microversion: 2.20 time: 0.166060 May 26 15:16:02.375074 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 323/679] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:16:02 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:16:02.902019 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-e613d9ff-9d70-48f2-83e2-53bf89ef33a4 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:02.902619 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-e613d9ff-9d70-48f2-83e2-53bf89ef33a4 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:02.909193 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e613d9ff-9d70-48f2-83e2-53bf89ef33a4 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:02.909633 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e613d9ff-9d70-48f2-83e2-53bf89ef33a4 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:02.911072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e613d9ff-9d70-48f2-83e2-53bf89ef33a4 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:02.912045 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e613d9ff-9d70-48f2-83e2-53bf89ef33a4 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:03.052136 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-e613d9ff-9d70-48f2-83e2-53bf89ef33a4 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:03.059949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-e613d9ff-9d70-48f2-83e2-53bf89ef33a4 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1690 microversion: 2.1 time: 0.161754 May 26 15:16:03.060530 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 357/680] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:16:02 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:16:03.393111 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-cd134607-e77d-4f39-be1a-529de1e7dbb5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:03.393954 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-cd134607-e77d-4f39-be1a-529de1e7dbb5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:03.401754 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cd134607-e77d-4f39-be1a-529de1e7dbb5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:03.402188 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cd134607-e77d-4f39-be1a-529de1e7dbb5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:03.402940 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cd134607-e77d-4f39-be1a-529de1e7dbb5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:03.403396 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cd134607-e77d-4f39-be1a-529de1e7dbb5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:03.548515 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-cd134607-e77d-4f39-be1a-529de1e7dbb5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:03.556912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-cd134607-e77d-4f39-be1a-529de1e7dbb5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:03.558410 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-cd134607-e77d-4f39-be1a-529de1e7dbb5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:03.559555 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-cd134607-e77d-4f39-be1a-529de1e7dbb5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1407 microversion: 2.20 time: 0.170404 May 26 15:16:03.560121 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 324/681] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:16:03 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:16:04.078067 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-e4bb239e-8968-4b5e-8636-295f67a05a8f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:04.078688 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-e4bb239e-8968-4b5e-8636-295f67a05a8f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:04.085609 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e4bb239e-8968-4b5e-8636-295f67a05a8f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:04.086054 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e4bb239e-8968-4b5e-8636-295f67a05a8f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:04.086833 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e4bb239e-8968-4b5e-8636-295f67a05a8f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:04.087300 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e4bb239e-8968-4b5e-8636-295f67a05a8f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:04.240083 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-e4bb239e-8968-4b5e-8636-295f67a05a8f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:04.248260 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-e4bb239e-8968-4b5e-8636-295f67a05a8f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1690 microversion: 2.1 time: 0.173983 May 26 15:16:04.248953 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 358/682] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:16:04 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1690 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:16:04.578039 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-6c74b4de-72aa-441f-98ba-51ef787f8372 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:04.578589 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-6c74b4de-72aa-441f-98ba-51ef787f8372 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:04.585834 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6c74b4de-72aa-441f-98ba-51ef787f8372 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:04.586275 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6c74b4de-72aa-441f-98ba-51ef787f8372 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:04.587046 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6c74b4de-72aa-441f-98ba-51ef787f8372 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:04.587503 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6c74b4de-72aa-441f-98ba-51ef787f8372 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:04.721175 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6c74b4de-72aa-441f-98ba-51ef787f8372 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:04.729431 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6c74b4de-72aa-441f-98ba-51ef787f8372 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:04.730932 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6c74b4de-72aa-441f-98ba-51ef787f8372 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:04.732086 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-6c74b4de-72aa-441f-98ba-51ef787f8372 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1407 microversion: 2.20 time: 0.158083 May 26 15:16:04.732653 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 325/683] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:16:04 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:16:05.265507 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-72bf3ea5-45e3-4131-a477-2c42fdbd459b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:05.266120 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-72bf3ea5-45e3-4131-a477-2c42fdbd459b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:05.274259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-72bf3ea5-45e3-4131-a477-2c42fdbd459b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:05.274715 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-72bf3ea5-45e3-4131-a477-2c42fdbd459b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:05.275532 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-72bf3ea5-45e3-4131-a477-2c42fdbd459b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:05.275988 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-72bf3ea5-45e3-4131-a477-2c42fdbd459b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:05.412593 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-72bf3ea5-45e3-4131-a477-2c42fdbd459b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:05.420151 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-72bf3ea5-45e3-4131-a477-2c42fdbd459b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1690 microversion: 2.1 time: 0.158589 May 26 15:16:05.420718 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 359/684] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:16:05 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:16:05.750612 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-9939680b-29f9-48e9-bbe6-99071b4abb01 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:05.751354 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-9939680b-29f9-48e9-bbe6-99071b4abb01 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:05.758799 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9939680b-29f9-48e9-bbe6-99071b4abb01 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:05.759289 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9939680b-29f9-48e9-bbe6-99071b4abb01 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:05.760068 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9939680b-29f9-48e9-bbe6-99071b4abb01 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:05.760505 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9939680b-29f9-48e9-bbe6-99071b4abb01 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:05.896589 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-9939680b-29f9-48e9-bbe6-99071b4abb01 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:05.904863 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-9939680b-29f9-48e9-bbe6-99071b4abb01 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:05.906363 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-9939680b-29f9-48e9-bbe6-99071b4abb01 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:05.907515 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-9939680b-29f9-48e9-bbe6-99071b4abb01 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1407 microversion: 2.20 time: 0.160932 May 26 15:16:05.908076 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 326/685] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:16:05 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:16:06.438549 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-ba1602a0-1776-4375-aa41-0d5b9ef83649 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:06.439190 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-ba1602a0-1776-4375-aa41-0d5b9ef83649 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:06.446683 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ba1602a0-1776-4375-aa41-0d5b9ef83649 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:06.447167 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ba1602a0-1776-4375-aa41-0d5b9ef83649 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:06.448148 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ba1602a0-1776-4375-aa41-0d5b9ef83649 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:06.448595 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ba1602a0-1776-4375-aa41-0d5b9ef83649 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:06.521379 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-ba1602a0-1776-4375-aa41-0d5b9ef83649 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:06.530168 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-ba1602a0-1776-4375-aa41-0d5b9ef83649 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1622 microversion: 2.1 time: 0.095565 May 26 15:16:06.531268 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 360/686] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:16:06 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1622 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:16:06.536554 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-df025ca9-acb8-4073-9de0-a42d1ad1a082 req-3ec3c0ef-0cae-419a-997d-88cd234e88a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b", "name": "network-vif-deleted", "tag": "cb40c287-1f0d-473f-ac8a-df78c43b1820"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:16:06.545044 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-df025ca9-acb8-4073-9de0-a42d1ad1a082 req-3ec3c0ef-0cae-419a-997d-88cd234e88a8 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:06.545487 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-df025ca9-acb8-4073-9de0-a42d1ad1a082 req-3ec3c0ef-0cae-419a-997d-88cd234e88a8 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:06.559543 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-df025ca9-acb8-4073-9de0-a42d1ad1a082 req-3ec3c0ef-0cae-419a-997d-88cd234e88a8 service nova] Creating event network-vif-deleted:cb40c287-1f0d-473f-ac8a-df78c43b1820 for instance b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b on hv-cinder-84301 May 26 15:16:06.564756 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-df025ca9-acb8-4073-9de0-a42d1ad1a082 req-3ec3c0ef-0cae-419a-997d-88cd234e88a8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035069 May 26 15:16:06.565409 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 327/687] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:16:06.930002 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-99031f6d-f96e-470b-9125-eb79c3fca74e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:06.930221 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-99031f6d-f96e-470b-9125-eb79c3fca74e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:06.937679 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-99031f6d-f96e-470b-9125-eb79c3fca74e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:06.938270 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-99031f6d-f96e-470b-9125-eb79c3fca74e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:06.939469 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-99031f6d-f96e-470b-9125-eb79c3fca74e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:06.940069 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-99031f6d-f96e-470b-9125-eb79c3fca74e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:07.112888 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-99031f6d-f96e-470b-9125-eb79c3fca74e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:07.124163 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-99031f6d-f96e-470b-9125-eb79c3fca74e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:07.126839 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-99031f6d-f96e-470b-9125-eb79c3fca74e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:07.128576 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-99031f6d-f96e-470b-9125-eb79c3fca74e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1407 microversion: 2.20 time: 0.204919 May 26 15:16:07.130141 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 361/688] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:16:06 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:16:07.549881 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f5bfe0d7-4dd6-49c0-9996-fce358a26bf8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:07.550573 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f5bfe0d7-4dd6-49c0-9996-fce358a26bf8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:07.560761 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f5bfe0d7-4dd6-49c0-9996-fce358a26bf8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:07.561202 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f5bfe0d7-4dd6-49c0-9996-fce358a26bf8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:07.561980 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f5bfe0d7-4dd6-49c0-9996-fce358a26bf8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:07.562403 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f5bfe0d7-4dd6-49c0-9996-fce358a26bf8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:07.602715 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f5bfe0d7-4dd6-49c0-9996-fce358a26bf8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:07.602715 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f5bfe0d7-4dd6-49c0-9996-fce358a26bf8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:07.602715 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.objects.instance [None req-f5bfe0d7-4dd6-49c0-9996-fce358a26bf8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lazy-loading 'fault' on Instance uuid b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b {{(pid=117798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:16:07.667363 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f5bfe0d7-4dd6-49c0-9996-fce358a26bf8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:07.674863 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f5bfe0d7-4dd6-49c0-9996-fce358a26bf8 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 200 len: 1335 microversion: 2.1 time: 0.130444 May 26 15:16:07.676430 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 328/689] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:16:07 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 1335 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:16:08.148586 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-a3e5b625-9e95-48a3-847f-1fe58a9112e6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:08.149202 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-a3e5b625-9e95-48a3-847f-1fe58a9112e6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:08.155859 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a3e5b625-9e95-48a3-847f-1fe58a9112e6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:08.156319 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a3e5b625-9e95-48a3-847f-1fe58a9112e6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:08.157096 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a3e5b625-9e95-48a3-847f-1fe58a9112e6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:08.157534 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a3e5b625-9e95-48a3-847f-1fe58a9112e6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:08.293682 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-a3e5b625-9e95-48a3-847f-1fe58a9112e6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:08.301945 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-a3e5b625-9e95-48a3-847f-1fe58a9112e6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:08.303480 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-a3e5b625-9e95-48a3-847f-1fe58a9112e6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:08.304655 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-a3e5b625-9e95-48a3-847f-1fe58a9112e6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1600 microversion: 2.20 time: 0.160922 May 26 15:16:08.305213 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 362/690] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:16:08 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:16:08.322883 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-acfb20fb-3193-4bf7-b400-8de8ab3d240e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:08.323406 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-acfb20fb-3193-4bf7-b400-8de8ab3d240e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:08.329520 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-acfb20fb-3193-4bf7-b400-8de8ab3d240e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:08.329969 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-acfb20fb-3193-4bf7-b400-8de8ab3d240e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:08.330744 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-acfb20fb-3193-4bf7-b400-8de8ab3d240e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:08.331215 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-acfb20fb-3193-4bf7-b400-8de8ab3d240e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:08.413498 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-acfb20fb-3193-4bf7-b400-8de8ab3d240e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.094486 May 26 15:16:08.414103 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 329/691] 10.222.0.45 () {60 vars in 1315 bytes} [Thu May 26 15:16:08 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 15:16:08.693300 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-c80dcac4-6ac5-4345-bc04-f29ff4bea498 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:08.693824 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-c80dcac4-6ac5-4345-bc04-f29ff4bea498 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:08.700655 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c80dcac4-6ac5-4345-bc04-f29ff4bea498 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:08.701101 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c80dcac4-6ac5-4345-bc04-f29ff4bea498 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:08.701873 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c80dcac4-6ac5-4345-bc04-f29ff4bea498 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:08.702308 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c80dcac4-6ac5-4345-bc04-f29ff4bea498 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:08.717877 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.wsgi [None req-c80dcac4-6ac5-4345-bc04-f29ff4bea498 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] HTTP exception thrown: Instance b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b could not be found. May 26 15:16:08.719591 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-c80dcac4-6ac5-4345-bc04-f29ff4bea498 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Request method failure captured: May 26 15:16:08.719591 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: request: GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b HTTP/1.1 May 26 15:16:08.719591 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept: application/json May 26 15:16:08.719591 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept-Encoding: identity May 26 15:16:08.719591 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Connection: close May 26 15:16:08.719591 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Length: 0 May 26 15:16:08.719591 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Type: application/json May 26 15:16:08.719591 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Host: 10.222.0.45 May 26 15:16:08.719591 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Openstack-System-Scope: None May 26 15:16:08.719591 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: User-Agent: python-urllib3/1.26.9 May 26 15:16:08.719591 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Auth-Token: gAAAAABij5gMlm5GpsxSW-5gFPLeSCTTSlLXjA9pJg4tHLzyoI_w98hI0aHKaaT7EayS7FvKHWCko4QlLuTbGjrbvwimGwYrU0rK44Sp3IWWOQnjEQh2Is81shN7a9UOyTdxs6LiujiFiQVD-wz53JvK2hkeV3IEn6BZKmbirZ2HujAlq8eqdqQ May 26 15:16:08.719591 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Id: None May 26 15:16:08.719591 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Name: None May 26 15:16:08.719591 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Identity-Status: Confirmed May 26 15:16:08.719591 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Is-Admin-Project: True May 26 15:16:08.719591 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Id: default May 26 15:16:08.719591 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Name: Default May 26 15:16:08.719591 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Id: bf95995343d547f78ae88a425f584ac7 May 26 15:16:08.719591 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1170690922 May 26 15:16:08.719591 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Role: reader,member May 26 15:16:08.719591 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Roles: reader,member May 26 15:16:08.721228 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bf95995343d547f78ae88a425f584ac7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bf95995343d547f78ae88a425f584ac7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/bf95995343d547f78ae88a425f584ac7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_bf95995343d547f78ae88a425f584ac7"}]}] May 26 15:16:08.721228 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1170690922 May 26 15:16:08.721228 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Id: bf95995343d547f78ae88a425f584ac7 May 26 15:16:08.721228 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1170690922 May 26 15:16:08.721228 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User: tempest-ServerRescueNegativeTestJSON-1170690922-project May 26 15:16:08.721228 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Id: default May 26 15:16:08.721228 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Name: Default May 26 15:16:08.721228 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Id: e29a5217495c41dda9564db96f6e36d1 May 26 15:16:08.721228 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1170690922-project May 26 15:16:08.721228 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: method: > May 26 15:16:08.721228 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: exception: Instance b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b could not be found. May 26 15:16:08.721228 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: action_args: {'id': 'b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b'} May 26 15:16:08.722140 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:16:08.722140 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:16:08.722140 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:16:08.722140 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:16:08.722140 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:16:08.722140 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:16:08.722140 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:16:08.722140 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:16:08.722140 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:16:08.722140 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:16:08.722140 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b could not be found. May 26 15:16:08.722140 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:16:08.722140 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:16:08.722140 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:16:08.722140 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:16:08.722140 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:16:08.722140 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:16:08.722140 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:16:08.722140 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:16:08.722140 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:16:08.724272 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:16:08.724272 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:16:08.724272 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:16:08.724272 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:16:08.724272 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:16:08.724272 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:16:08.724272 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:16:08.724272 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b could not be found. May 26 15:16:08.724272 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:16:08.724272 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:16:08.724272 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:16:08.724272 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:16:08.724272 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:16:08.724272 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:16:08.724272 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:16:08.724272 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:16:08.724272 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b could not be found. May 26 15:16:08.724272 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:16:08.725924 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-c80dcac4-6ac5-4345-bc04-f29ff4bea498 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Returning 404 to user: Instance b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b could not be found. {{(pid=117799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:16:08.725924 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-c80dcac4-6ac5-4345-bc04-f29ff4bea498 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b" status: 404 len: 111 microversion: 2.1 time: 0.032648 May 26 15:16:08.725924 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 363/692] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:16:08 2022] GET /compute/v2.1/servers/b73902e1-48a2-4e30-9d54-f2e7cbc7aa6b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:16:08.732936 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-fc2bc0db-86dc-4897-8ed8-c077a5a9708b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '.version_select at 0x7ffb5e7b1670>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:08.752277 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-fc2bc0db-86dc-4897-8ed8-c077a5a9708b tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1119036631" status: 202 len: 0 microversion: 2.1 time: 0.023607 May 26 15:16:08.752867 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 330/693] 10.222.0.45 () {58 vars in 1220 bytes} [Thu May 26 15:16:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1119036631 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 15:16:09.426527 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-f7674a58-8d57-491e-871a-91927c843e5c req-031af8e2-08dc-485d-b9b0-e0194667a633 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d97e6323-aeef-4755-9bc5-93ae5140640b", "tag": "88cc91ef-0c85-4971-928d-0eb2739f6222"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:16:09.437317 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-f7674a58-8d57-491e-871a-91927c843e5c req-031af8e2-08dc-485d-b9b0-e0194667a633 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:09.438117 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-f7674a58-8d57-491e-871a-91927c843e5c req-031af8e2-08dc-485d-b9b0-e0194667a633 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:09.455029 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-f7674a58-8d57-491e-871a-91927c843e5c req-031af8e2-08dc-485d-b9b0-e0194667a633 service nova] Creating event network-changed:88cc91ef-0c85-4971-928d-0eb2739f6222 for instance d97e6323-aeef-4755-9bc5-93ae5140640b on hv-cinder-84301 May 26 15:16:09.461557 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-f7674a58-8d57-491e-871a-91927c843e5c req-031af8e2-08dc-485d-b9b0-e0194667a633 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040182 May 26 15:16:09.462964 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 364/694] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:16:12.130835 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ace3591a-d6ec-4e78-be84-eb69168e33f9 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:12.131417 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ace3591a-d6ec-4e78-be84-eb69168e33f9 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:12.133283 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=2 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:12.139406 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ace3591a-d6ec-4e78-be84-eb69168e33f9 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:12.139854 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ace3591a-d6ec-4e78-be84-eb69168e33f9 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:12.140635 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ace3591a-d6ec-4e78-be84-eb69168e33f9 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:12.141060 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ace3591a-d6ec-4e78-be84-eb69168e33f9 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:12.167261 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ace3591a-d6ec-4e78-be84-eb69168e33f9 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Going to try to terminate instance {{(pid=117798) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:16:12.200820 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:12.248123 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ace3591a-d6ec-4e78-be84-eb69168e33f9 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "DELETE /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 204 len: 0 microversion: 2.1 time: 0.121627 May 26 15:16:12.249431 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 331/695] 10.222.0.45 () {58 vars in 1238 bytes} [Thu May 26 15:16:12 2022] DELETE /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:16:12.258690 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-988d8c3d-6d09-4c21-927b-d50708260ab6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:12.259424 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-988d8c3d-6d09-4c21-927b-d50708260ab6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:12.265710 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-988d8c3d-6d09-4c21-927b-d50708260ab6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:12.266156 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-988d8c3d-6d09-4c21-927b-d50708260ab6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:12.266926 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-988d8c3d-6d09-4c21-927b-d50708260ab6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:12.267452 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-988d8c3d-6d09-4c21-927b-d50708260ab6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:12.283208 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:12.405980 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-988d8c3d-6d09-4c21-927b-d50708260ab6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:12.413611 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-988d8c3d-6d09-4c21-927b-d50708260ab6 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1507 microversion: 2.1 time: 0.159731 May 26 15:16:12.414172 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 365/696] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:16:12 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:16:13.430959 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1e94513a-0f64-4dc8-88bb-926015e72cfd tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:13.431703 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1e94513a-0f64-4dc8-88bb-926015e72cfd tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:13.438260 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1e94513a-0f64-4dc8-88bb-926015e72cfd tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:13.438712 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1e94513a-0f64-4dc8-88bb-926015e72cfd tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:13.439525 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1e94513a-0f64-4dc8-88bb-926015e72cfd tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:13.439963 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1e94513a-0f64-4dc8-88bb-926015e72cfd tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:13.591147 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1e94513a-0f64-4dc8-88bb-926015e72cfd tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:13.599261 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1e94513a-0f64-4dc8-88bb-926015e72cfd tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 200 len: 1507 microversion: 2.1 time: 0.173120 May 26 15:16:13.600326 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 332/697] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:16:13 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 1507 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:16:13.854751 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-3386861e-0637-4d9a-b748-8bae6e462643 req-9cb8a1b4-d4ea-4976-8c1c-b779b816f7f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44b285a0-afad-471d-8d28-7e8972acca1a", "name": "network-vif-deleted", "tag": "c2e407fa-92ac-42e8-af38-3255afe28425"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:16:13.870581 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-3386861e-0637-4d9a-b748-8bae6e462643 req-9cb8a1b4-d4ea-4976-8c1c-b779b816f7f6 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:13.871198 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-3386861e-0637-4d9a-b748-8bae6e462643 req-9cb8a1b4-d4ea-4976-8c1c-b779b816f7f6 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:13.885478 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-3386861e-0637-4d9a-b748-8bae6e462643 req-9cb8a1b4-d4ea-4976-8c1c-b779b816f7f6 service nova] Creating event network-vif-deleted:c2e407fa-92ac-42e8-af38-3255afe28425 for instance 44b285a0-afad-471d-8d28-7e8972acca1a on hv-cinder-84301 May 26 15:16:13.892983 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-3386861e-0637-4d9a-b748-8bae6e462643 req-9cb8a1b4-d4ea-4976-8c1c-b779b816f7f6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044807 May 26 15:16:13.894094 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 366/698] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:16:14.617167 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ff51cf36-31b0-4254-9d44-fc2ed6e7e732 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:14.617759 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ff51cf36-31b0-4254-9d44-fc2ed6e7e732 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: 44b285a0-afad-471d-8d28-7e8972acca1a] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:14.624538 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ff51cf36-31b0-4254-9d44-fc2ed6e7e732 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:14.624987 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ff51cf36-31b0-4254-9d44-fc2ed6e7e732 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:14.625766 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ff51cf36-31b0-4254-9d44-fc2ed6e7e732 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:14.626197 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ff51cf36-31b0-4254-9d44-fc2ed6e7e732 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:14.640762 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-ff51cf36-31b0-4254-9d44-fc2ed6e7e732 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] HTTP exception thrown: Instance 44b285a0-afad-471d-8d28-7e8972acca1a could not be found. May 26 15:16:14.642500 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ff51cf36-31b0-4254-9d44-fc2ed6e7e732 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Request method failure captured: May 26 15:16:14.642500 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: request: GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a HTTP/1.1 May 26 15:16:14.642500 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept: application/json May 26 15:16:14.642500 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity May 26 15:16:14.642500 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Connection: close May 26 15:16:14.642500 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Length: 0 May 26 15:16:14.642500 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Type: application/json May 26 15:16:14.642500 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Host: 10.222.0.45 May 26 15:16:14.642500 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None May 26 15:16:14.642500 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 May 26 15:16:14.642500 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABij5gMlm5GpsxSW-5gFPLeSCTTSlLXjA9pJg4tHLzyoI_w98hI0aHKaaT7EayS7FvKHWCko4QlLuTbGjrbvwimGwYrU0rK44Sp3IWWOQnjEQh2Is81shN7a9UOyTdxs6LiujiFiQVD-wz53JvK2hkeV3IEn6BZKmbirZ2HujAlq8eqdqQ May 26 15:16:14.642500 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Id: None May 26 15:16:14.642500 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Name: None May 26 15:16:14.642500 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed May 26 15:16:14.642500 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True May 26 15:16:14.642500 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default May 26 15:16:14.642500 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default May 26 15:16:14.642500 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Id: bf95995343d547f78ae88a425f584ac7 May 26 15:16:14.642500 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1170690922 May 26 15:16:14.642500 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Role: reader,member May 26 15:16:14.642500 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Roles: reader,member May 26 15:16:14.644237 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bf95995343d547f78ae88a425f584ac7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bf95995343d547f78ae88a425f584ac7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/bf95995343d547f78ae88a425f584ac7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_bf95995343d547f78ae88a425f584ac7"}]}] May 26 15:16:14.644237 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1170690922 May 26 15:16:14.644237 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Id: bf95995343d547f78ae88a425f584ac7 May 26 15:16:14.644237 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1170690922 May 26 15:16:14.644237 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User: tempest-ServerRescueNegativeTestJSON-1170690922-project May 26 15:16:14.644237 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default May 26 15:16:14.644237 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default May 26 15:16:14.644237 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Id: e29a5217495c41dda9564db96f6e36d1 May 26 15:16:14.644237 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1170690922-project May 26 15:16:14.644237 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: method: > May 26 15:16:14.644237 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: exception: Instance 44b285a0-afad-471d-8d28-7e8972acca1a could not be found. May 26 15:16:14.644237 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: action_args: {'id': '44b285a0-afad-471d-8d28-7e8972acca1a'} May 26 15:16:14.645082 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:16:14.645082 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:16:14.645082 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:16:14.645082 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:16:14.645082 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:16:14.645082 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:16:14.645082 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:16:14.645082 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:16:14.645082 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:16:14.645082 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:16:14.645082 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44b285a0-afad-471d-8d28-7e8972acca1a could not be found. May 26 15:16:14.645082 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:16:14.645082 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:16:14.645082 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:16:14.645082 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:16:14.645082 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:16:14.645082 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:16:14.645082 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:16:14.645082 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:16:14.645082 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:16:14.646258 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:16:14.646258 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:16:14.646258 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:16:14.646258 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:16:14.646258 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:16:14.646258 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:16:14.646258 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:16:14.646258 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44b285a0-afad-471d-8d28-7e8972acca1a could not be found. May 26 15:16:14.646258 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:16:14.646258 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:16:14.646258 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:16:14.646258 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:16:14.646258 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:16:14.646258 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:16:14.646258 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:16:14.646258 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:16:14.646258 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44b285a0-afad-471d-8d28-7e8972acca1a could not be found. May 26 15:16:14.646258 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:16:14.647333 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ff51cf36-31b0-4254-9d44-fc2ed6e7e732 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Returning 404 to user: Instance 44b285a0-afad-471d-8d28-7e8972acca1a could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:16:14.647333 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ff51cf36-31b0-4254-9d44-fc2ed6e7e732 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a" status: 404 len: 111 microversion: 2.1 time: 0.031579 May 26 15:16:14.647333 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 333/699] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:16:14 2022] GET /compute/v2.1/servers/44b285a0-afad-471d-8d28-7e8972acca1a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:16:14.653976 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-a0039830-4b79-4b7b-ab5f-f8d37ae0ade5 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:14.654556 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-a0039830-4b79-4b7b-ab5f-f8d37ae0ade5 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: ab471a8e-c724-4c71-b9ce-b253771d23a1] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:14.661347 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a0039830-4b79-4b7b-ab5f-f8d37ae0ade5 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:14.661790 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a0039830-4b79-4b7b-ab5f-f8d37ae0ade5 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:14.662551 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a0039830-4b79-4b7b-ab5f-f8d37ae0ade5 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:14.662990 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a0039830-4b79-4b7b-ab5f-f8d37ae0ade5 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:14.689480 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-a0039830-4b79-4b7b-ab5f-f8d37ae0ade5 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: ab471a8e-c724-4c71-b9ce-b253771d23a1] Going to try to terminate instance {{(pid=117799) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:16:14.771548 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-a0039830-4b79-4b7b-ab5f-f8d37ae0ade5 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1" status: 204 len: 0 microversion: 2.1 time: 0.121471 May 26 15:16:14.777003 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 367/700] 10.222.0.45 () {58 vars in 1238 bytes} [Thu May 26 15:16:14 2022] DELETE /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:16:14.783185 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-5618ec23-04f3-4629-bf98-43df1d185d0d tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:14.783808 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-5618ec23-04f3-4629-bf98-43df1d185d0d tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: ab471a8e-c724-4c71-b9ce-b253771d23a1] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:14.790130 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5618ec23-04f3-4629-bf98-43df1d185d0d tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:14.790580 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5618ec23-04f3-4629-bf98-43df1d185d0d tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:14.791386 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5618ec23-04f3-4629-bf98-43df1d185d0d tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:14.791821 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5618ec23-04f3-4629-bf98-43df1d185d0d tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:14.930987 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-5618ec23-04f3-4629-bf98-43df1d185d0d tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:14.938533 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-5618ec23-04f3-4629-bf98-43df1d185d0d tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1" status: 200 len: 1522 microversion: 2.1 time: 0.159482 May 26 15:16:14.939130 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 334/701] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:16:14 2022] GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:16:15.957739 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-673c0fda-ee57-4760-936d-7931cf9e4ec5 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:15.958284 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-673c0fda-ee57-4760-936d-7931cf9e4ec5 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: ab471a8e-c724-4c71-b9ce-b253771d23a1] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:15.964836 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-673c0fda-ee57-4760-936d-7931cf9e4ec5 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:15.965274 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-673c0fda-ee57-4760-936d-7931cf9e4ec5 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:15.966051 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-673c0fda-ee57-4760-936d-7931cf9e4ec5 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:15.966483 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-673c0fda-ee57-4760-936d-7931cf9e4ec5 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:16.112696 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-673c0fda-ee57-4760-936d-7931cf9e4ec5 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e29a5217495c41dda9564db96f6e36d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf95995343d547f78ae88a425f584ac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:16.121016 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-673c0fda-ee57-4760-936d-7931cf9e4ec5 tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1" status: 200 len: 1522 microversion: 2.1 time: 0.168407 May 26 15:16:16.121606 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 368/702] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:16:15 2022] GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:16:16.376099 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-d1683ab1-2538-4e48-a5ee-0a2cd0a9f813 req-8cad0e0d-d098-4a9c-b3bc-2be2588c3870 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab471a8e-c724-4c71-b9ce-b253771d23a1", "name": "network-vif-deleted", "tag": "fb04c6b8-9901-4e4f-acc2-c4c580e85f3e"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:16:16.386200 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-d1683ab1-2538-4e48-a5ee-0a2cd0a9f813 req-8cad0e0d-d098-4a9c-b3bc-2be2588c3870 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:16.386643 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-d1683ab1-2538-4e48-a5ee-0a2cd0a9f813 req-8cad0e0d-d098-4a9c-b3bc-2be2588c3870 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:16.402453 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-d1683ab1-2538-4e48-a5ee-0a2cd0a9f813 req-8cad0e0d-d098-4a9c-b3bc-2be2588c3870 service nova] Creating event network-vif-deleted:fb04c6b8-9901-4e4f-acc2-c4c580e85f3e for instance ab471a8e-c724-4c71-b9ce-b253771d23a1 on hv-cinder-84301 May 26 15:16:16.409520 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-d1683ab1-2538-4e48-a5ee-0a2cd0a9f813 req-8cad0e0d-d098-4a9c-b3bc-2be2588c3870 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036516 May 26 15:16:16.410436 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 335/703] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:16:17.138097 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-b947a21b-c680-4feb-9f3e-9c06ef5e3e4f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:17.138704 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-b947a21b-c680-4feb-9f3e-9c06ef5e3e4f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] [instance: ab471a8e-c724-4c71-b9ce-b253771d23a1] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:17.147321 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b947a21b-c680-4feb-9f3e-9c06ef5e3e4f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:17.147765 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b947a21b-c680-4feb-9f3e-9c06ef5e3e4f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:17.148539 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b947a21b-c680-4feb-9f3e-9c06ef5e3e4f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:17.148960 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b947a21b-c680-4feb-9f3e-9c06ef5e3e4f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:17.163497 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.wsgi [None req-b947a21b-c680-4feb-9f3e-9c06ef5e3e4f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] HTTP exception thrown: Instance ab471a8e-c724-4c71-b9ce-b253771d23a1 could not be found. May 26 15:16:17.165050 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-b947a21b-c680-4feb-9f3e-9c06ef5e3e4f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Request method failure captured: May 26 15:16:17.165050 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: request: GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1 HTTP/1.1 May 26 15:16:17.165050 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept: application/json May 26 15:16:17.165050 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept-Encoding: identity May 26 15:16:17.165050 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Connection: close May 26 15:16:17.165050 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Length: 0 May 26 15:16:17.165050 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Type: application/json May 26 15:16:17.165050 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Host: 10.222.0.45 May 26 15:16:17.165050 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Openstack-System-Scope: None May 26 15:16:17.165050 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: User-Agent: python-urllib3/1.26.9 May 26 15:16:17.165050 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Auth-Token: gAAAAABij5gMlm5GpsxSW-5gFPLeSCTTSlLXjA9pJg4tHLzyoI_w98hI0aHKaaT7EayS7FvKHWCko4QlLuTbGjrbvwimGwYrU0rK44Sp3IWWOQnjEQh2Is81shN7a9UOyTdxs6LiujiFiQVD-wz53JvK2hkeV3IEn6BZKmbirZ2HujAlq8eqdqQ May 26 15:16:17.165050 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Id: None May 26 15:16:17.165050 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Name: None May 26 15:16:17.165050 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Identity-Status: Confirmed May 26 15:16:17.165050 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Is-Admin-Project: True May 26 15:16:17.165050 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Id: default May 26 15:16:17.165050 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Name: Default May 26 15:16:17.165050 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Id: bf95995343d547f78ae88a425f584ac7 May 26 15:16:17.165050 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1170690922 May 26 15:16:17.165050 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Role: reader,member May 26 15:16:17.165050 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Roles: reader,member May 26 15:16:17.166551 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bf95995343d547f78ae88a425f584ac7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bf95995343d547f78ae88a425f584ac7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/bf95995343d547f78ae88a425f584ac7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_bf95995343d547f78ae88a425f584ac7"}]}] May 26 15:16:17.166551 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1170690922 May 26 15:16:17.166551 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Id: bf95995343d547f78ae88a425f584ac7 May 26 15:16:17.166551 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1170690922 May 26 15:16:17.166551 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User: tempest-ServerRescueNegativeTestJSON-1170690922-project May 26 15:16:17.166551 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Id: default May 26 15:16:17.166551 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Name: Default May 26 15:16:17.166551 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Id: e29a5217495c41dda9564db96f6e36d1 May 26 15:16:17.166551 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1170690922-project May 26 15:16:17.166551 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: method: > May 26 15:16:17.166551 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: exception: Instance ab471a8e-c724-4c71-b9ce-b253771d23a1 could not be found. May 26 15:16:17.166551 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: action_args: {'id': 'ab471a8e-c724-4c71-b9ce-b253771d23a1'} May 26 15:16:17.167363 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:16:17.167363 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:16:17.167363 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:16:17.167363 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:16:17.167363 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:16:17.167363 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:16:17.167363 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:16:17.167363 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:16:17.167363 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:16:17.167363 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:16:17.167363 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab471a8e-c724-4c71-b9ce-b253771d23a1 could not be found. May 26 15:16:17.167363 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:16:17.167363 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:16:17.167363 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:16:17.167363 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:16:17.167363 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:16:17.167363 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:16:17.167363 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:16:17.167363 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:16:17.167363 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:16:17.168951 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:16:17.168951 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:16:17.168951 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:16:17.168951 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:16:17.168951 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:16:17.168951 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:16:17.168951 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:16:17.168951 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab471a8e-c724-4c71-b9ce-b253771d23a1 could not be found. May 26 15:16:17.168951 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:16:17.168951 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:16:17.168951 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:16:17.168951 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:16:17.168951 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:16:17.168951 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:16:17.168951 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:16:17.168951 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:16:17.168951 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab471a8e-c724-4c71-b9ce-b253771d23a1 could not be found. May 26 15:16:17.168951 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:16:17.170460 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-b947a21b-c680-4feb-9f3e-9c06ef5e3e4f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] Returning 404 to user: Instance ab471a8e-c724-4c71-b9ce-b253771d23a1 could not be found. {{(pid=117799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:16:17.170460 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-b947a21b-c680-4feb-9f3e-9c06ef5e3e4f tempest-ServerRescueNegativeTestJSON-1170690922 tempest-ServerRescueNegativeTestJSON-1170690922-project] 10.222.0.45 "GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1" status: 404 len: 111 microversion: 2.1 time: 0.032258 May 26 15:16:17.170460 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 369/704] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:16:17 2022] GET /compute/v2.1/servers/ab471a8e-c724-4c71-b9ce-b253771d23a1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:16:22.489343 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f3d61b01-8762-4977-af60-e6acb51633fe tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:22.490355 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f3d61b01-8762-4977-af60-e6acb51633fe tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:22.496938 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f3d61b01-8762-4977-af60-e6acb51633fe tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:22.497308 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f3d61b01-8762-4977-af60-e6acb51633fe tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:22.498081 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f3d61b01-8762-4977-af60-e6acb51633fe tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:22.498512 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f3d61b01-8762-4977-af60-e6acb51633fe tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:22.529310 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f3d61b01-8762-4977-af60-e6acb51633fe tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045569 May 26 15:16:22.529965 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 336/705] 10.222.0.45 () {58 vars in 1301 bytes} [Thu May 26 15:16:22 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 15:16:22.599198 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-b752653e-03a3-4156-b611-7afb010276f7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:22.599198 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-b752653e-03a3-4156-b611-7afb010276f7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:22.605586 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b752653e-03a3-4156-b611-7afb010276f7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:22.606033 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b752653e-03a3-4156-b611-7afb010276f7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:22.606797 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b752653e-03a3-4156-b611-7afb010276f7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:22.607267 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b752653e-03a3-4156-b611-7afb010276f7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:22.634611 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-b752653e-03a3-4156-b611-7afb010276f7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Going to try to terminate instance {{(pid=117799) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:16:22.713792 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-b752653e-03a3-4156-b611-7afb010276f7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "DELETE /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 204 len: 0 microversion: 2.1 time: 0.119446 May 26 15:16:22.714479 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 370/706] 10.222.0.45 () {58 vars in 1238 bytes} [Thu May 26 15:16:22 2022] DELETE /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:16:22.723558 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-3d64f58f-19fa-4dcb-915b-39143d4b27f8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:22.724183 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-3d64f58f-19fa-4dcb-915b-39143d4b27f8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:22.730628 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3d64f58f-19fa-4dcb-915b-39143d4b27f8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:22.731398 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3d64f58f-19fa-4dcb-915b-39143d4b27f8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:22.732206 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3d64f58f-19fa-4dcb-915b-39143d4b27f8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:22.732646 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3d64f58f-19fa-4dcb-915b-39143d4b27f8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:22.871522 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-3d64f58f-19fa-4dcb-915b-39143d4b27f8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:22.879186 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-3d64f58f-19fa-4dcb-915b-39143d4b27f8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1673 microversion: 2.1 time: 0.160377 May 26 15:16:22.879759 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 337/707] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:16:22 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:16:23.897357 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-b1bf8ede-7654-4159-b01e-00bae5da4665 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:23.898059 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-b1bf8ede-7654-4159-b01e-00bae5da4665 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:23.904261 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b1bf8ede-7654-4159-b01e-00bae5da4665 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:23.904729 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b1bf8ede-7654-4159-b01e-00bae5da4665 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:23.905469 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b1bf8ede-7654-4159-b01e-00bae5da4665 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:23.905899 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b1bf8ede-7654-4159-b01e-00bae5da4665 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:24.059206 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-b1bf8ede-7654-4159-b01e-00bae5da4665 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:24.067793 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-b1bf8ede-7654-4159-b01e-00bae5da4665 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1673 microversion: 2.1 time: 0.175394 May 26 15:16:24.068380 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 371/708] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:16:23 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1673 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:16:25.086877 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c288350f-5464-4179-ab02-7fac4c6c6af9 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:25.088130 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c288350f-5464-4179-ab02-7fac4c6c6af9 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:25.097542 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c288350f-5464-4179-ab02-7fac4c6c6af9 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:25.098756 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c288350f-5464-4179-ab02-7fac4c6c6af9 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:25.099720 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c288350f-5464-4179-ab02-7fac4c6c6af9 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:25.100251 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c288350f-5464-4179-ab02-7fac4c6c6af9 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:25.261352 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c288350f-5464-4179-ab02-7fac4c6c6af9 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:25.272225 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c288350f-5464-4179-ab02-7fac4c6c6af9 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1673 microversion: 2.1 time: 0.190168 May 26 15:16:25.277831 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 338/709] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:16:25 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1673 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:16:25.701219 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-1b64b545-aa10-4557-a435-1936229c32a6 req-95de763a-a65c-488d-9836-871d06bde784 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d9c670-e34a-4363-9e60-745335a3ea6c", "name": "network-vif-deleted", "tag": "594748ba-cf8f-4cb8-bfc4-dba073613057"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:16:25.712660 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-1b64b545-aa10-4557-a435-1936229c32a6 req-95de763a-a65c-488d-9836-871d06bde784 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:25.713208 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-1b64b545-aa10-4557-a435-1936229c32a6 req-95de763a-a65c-488d-9836-871d06bde784 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:25.728316 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-1b64b545-aa10-4557-a435-1936229c32a6 req-95de763a-a65c-488d-9836-871d06bde784 service nova] Creating event network-vif-deleted:594748ba-cf8f-4cb8-bfc4-dba073613057 for instance 29d9c670-e34a-4363-9e60-745335a3ea6c on hv-cinder-84301 May 26 15:16:25.735382 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-1b64b545-aa10-4557-a435-1936229c32a6 req-95de763a-a65c-488d-9836-871d06bde784 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038419 May 26 15:16:25.743611 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 372/710] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:16:26.290649 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-585551ed-5afd-41d4-baa3-fcaeeba54fc9 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:26.291400 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-585551ed-5afd-41d4-baa3-fcaeeba54fc9 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:26.299130 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-585551ed-5afd-41d4-baa3-fcaeeba54fc9 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:26.299373 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-585551ed-5afd-41d4-baa3-fcaeeba54fc9 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:26.300159 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-585551ed-5afd-41d4-baa3-fcaeeba54fc9 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:26.301146 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-585551ed-5afd-41d4-baa3-fcaeeba54fc9 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:26.344219 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-585551ed-5afd-41d4-baa3-fcaeeba54fc9 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:26.345268 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-585551ed-5afd-41d4-baa3-fcaeeba54fc9 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:26.345810 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.objects.instance [None req-585551ed-5afd-41d4-baa3-fcaeeba54fc9 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lazy-loading 'fault' on Instance uuid 29d9c670-e34a-4363-9e60-745335a3ea6c {{(pid=117798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:16:26.407265 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-585551ed-5afd-41d4-baa3-fcaeeba54fc9 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:26.415260 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-585551ed-5afd-41d4-baa3-fcaeeba54fc9 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 200 len: 1327 microversion: 2.1 time: 0.128477 May 26 15:16:26.424726 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 339/711] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:16:26 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 1327 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:16:27.434690 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-b48541d9-28d9-4483-a1e3-727e0ae31649 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:27.436336 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-b48541d9-28d9-4483-a1e3-727e0ae31649 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:27.442939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b48541d9-28d9-4483-a1e3-727e0ae31649 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:27.443449 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b48541d9-28d9-4483-a1e3-727e0ae31649 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:27.444434 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b48541d9-28d9-4483-a1e3-727e0ae31649 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:27.445043 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b48541d9-28d9-4483-a1e3-727e0ae31649 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:27.459577 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.wsgi [None req-b48541d9-28d9-4483-a1e3-727e0ae31649 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] HTTP exception thrown: Instance 29d9c670-e34a-4363-9e60-745335a3ea6c could not be found. May 26 15:16:27.461231 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-b48541d9-28d9-4483-a1e3-727e0ae31649 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Request method failure captured: May 26 15:16:27.461231 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: request: GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c HTTP/1.1 May 26 15:16:27.461231 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept: application/json May 26 15:16:27.461231 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept-Encoding: identity May 26 15:16:27.461231 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Connection: close May 26 15:16:27.461231 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Length: 0 May 26 15:16:27.461231 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Type: application/json May 26 15:16:27.461231 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Host: 10.222.0.45 May 26 15:16:27.461231 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Openstack-System-Scope: None May 26 15:16:27.461231 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: User-Agent: python-urllib3/1.26.9 May 26 15:16:27.461231 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Auth-Token: gAAAAABij5gIExbyS76VlcxLoqQooFhb7Z8eRLQ49lj5E236AgcYQzWvrYNTDh3LsojPKqzwLYn8AdzTWzvcg-Xtk4RL20gFH_DNeuLEw9AbD2-2qHE9Ym4k68qhVJTCSvw2cCH9uYlhvEZWTdjhBQi1_8UmyiZ--_0tYCoQ-qfmOmmP1LkmeF0 May 26 15:16:27.461231 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Id: None May 26 15:16:27.461231 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Name: None May 26 15:16:27.461231 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Identity-Status: Confirmed May 26 15:16:27.461231 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Is-Admin-Project: True May 26 15:16:27.461231 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Id: default May 26 15:16:27.461231 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Name: Default May 26 15:16:27.461231 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Id: 85ea8fbf32d748a8ad70996a9fa12843 May 26 15:16:27.461231 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Name: tempest-AttachVolumeTestJSON-336307212 May 26 15:16:27.461231 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Role: reader,member May 26 15:16:27.461231 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Roles: reader,member May 26 15:16:27.462813 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/85ea8fbf32d748a8ad70996a9fa12843"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/85ea8fbf32d748a8ad70996a9fa12843"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/85ea8fbf32d748a8ad70996a9fa12843"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_85ea8fbf32d748a8ad70996a9fa12843"}]}] May 26 15:16:27.462813 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant: tempest-AttachVolumeTestJSON-336307212 May 26 15:16:27.462813 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Id: 85ea8fbf32d748a8ad70996a9fa12843 May 26 15:16:27.462813 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Name: tempest-AttachVolumeTestJSON-336307212 May 26 15:16:27.462813 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User: tempest-AttachVolumeTestJSON-336307212-project May 26 15:16:27.462813 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Id: default May 26 15:16:27.462813 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Name: Default May 26 15:16:27.462813 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Id: 9a671e0538ca45bbb44c298f1aa13a37 May 26 15:16:27.462813 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Name: tempest-AttachVolumeTestJSON-336307212-project May 26 15:16:27.462813 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: method: > May 26 15:16:27.462813 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: exception: Instance 29d9c670-e34a-4363-9e60-745335a3ea6c could not be found. May 26 15:16:27.462813 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: action_args: {'id': '29d9c670-e34a-4363-9e60-745335a3ea6c'} May 26 15:16:27.463809 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:16:27.463809 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:16:27.463809 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:16:27.463809 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:16:27.463809 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:16:27.463809 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:16:27.463809 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:16:27.463809 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:16:27.463809 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:16:27.463809 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:16:27.463809 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29d9c670-e34a-4363-9e60-745335a3ea6c could not be found. May 26 15:16:27.463809 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:16:27.463809 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:16:27.463809 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:16:27.463809 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:16:27.463809 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:16:27.463809 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:16:27.463809 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:16:27.463809 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:16:27.463809 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:16:27.465037 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:16:27.465037 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:16:27.465037 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:16:27.465037 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:16:27.465037 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:16:27.465037 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:16:27.465037 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:16:27.465037 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29d9c670-e34a-4363-9e60-745335a3ea6c could not be found. May 26 15:16:27.465037 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:16:27.465037 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:16:27.465037 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:16:27.465037 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:16:27.465037 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:16:27.465037 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:16:27.465037 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:16:27.465037 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:16:27.465037 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29d9c670-e34a-4363-9e60-745335a3ea6c could not be found. May 26 15:16:27.465037 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:16:27.466201 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-b48541d9-28d9-4483-a1e3-727e0ae31649 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Returning 404 to user: Instance 29d9c670-e34a-4363-9e60-745335a3ea6c could not be found. {{(pid=117799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:16:27.466201 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-b48541d9-28d9-4483-a1e3-727e0ae31649 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 404 len: 111 microversion: 2.1 time: 0.033535 May 26 15:16:27.466201 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 373/712] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:16:27 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:16:27.471593 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-70219575-a938-480e-b9b3-ab6373525955 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '.version_select at 0x7ffb5e5eb040>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:27.490124 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-70219575-a938-480e-b9b3-ab6373525955 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1782266556" status: 202 len: 0 microversion: 2.1 time: 0.022238 May 26 15:16:27.490725 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 340/713] 10.222.0.45 () {58 vars in 1220 bytes} [Thu May 26 15:16:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1782266556 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:16:28.202459 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-974af653-2960-461d-b84a-a47e061212c8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Action: 'create', calling method: .version_select at 0x7ffb5d676550>, body: {"keypair": {"name": "tempest-keypair-1746935605", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKk3XX5wNBKls6jbHTCfOX3v3ohsylNie8uRYyMmMWLv+Sm6tHg461bqmzdxUWee77Bz1WFLpeztt+kVMV0BXvCXL5OflZGdHFpQOn1Gxh6M+k+Pg9Jxs/POIenrdl5/cg=="}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:16:28.216909 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.quota [None req-974af653-2960-461d-b84a-a47e061212c8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Getting quotas for project 85ea8fbf32d748a8ad70996a9fa12843. Resources: {'key_pairs'} {{(pid=117799) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:16:28.221089 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.quota [None req-974af653-2960-461d-b84a-a47e061212c8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Getting quotas for user 9a671e0538ca45bbb44c298f1aa13a37 and project 85ea8fbf32d748a8ad70996a9fa12843. Resources: {'key_pairs'} {{(pid=117799) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:16:28.247407 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-974af653-2960-461d-b84a-a47e061212c8 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049224 May 26 15:16:28.248483 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 374/714] 10.222.0.45 () {60 vars in 1158 bytes} [Thu May 26 15:16:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:16:29.720775 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-7d6dc2f9-b7ce-404c-bea4-e756abbc535b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1593530637", "imageRef": "5b5a68b4-38e3-4f05-b97f-4339d6752e34", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "01254fed-0134-4032-8891-3e7c400b7875"}], "security_groups": [{"name": "tempest-securitygroup--1720316512"}], "key_name": "tempest-keypair-1746935605", "user_data": "}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:16:29.839106 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.network.neutron [None req-7d6dc2f9-b7ce-404c-bea4-e756abbc535b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] validate_networks() for [('01254fed-0134-4032-8891-3e7c400b7875', None, None, None, None, None)] {{(pid=117798) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:16:30.238984 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-7d6dc2f9-b7ce-404c-bea4-e756abbc535b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Flavor limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:16:30.239323 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-7d6dc2f9-b7ce-404c-bea4-e756abbc535b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Image limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:16:30.239797 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-7d6dc2f9-b7ce-404c-bea4-e756abbc535b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Flavor pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:16:30.240233 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-7d6dc2f9-b7ce-404c-bea4-e756abbc535b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Image pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:16:30.240649 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-7d6dc2f9-b7ce-404c-bea4-e756abbc535b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:16:30.251437 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7d6dc2f9-b7ce-404c-bea4-e756abbc535b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:30.251973 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7d6dc2f9-b7ce-404c-bea4-e756abbc535b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:30.253723 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7d6dc2f9-b7ce-404c-bea4-e756abbc535b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:30.256514 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7d6dc2f9-b7ce-404c-bea4-e756abbc535b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:30.272804 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-7d6dc2f9-b7ce-404c-bea4-e756abbc535b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Getting quotas for project 85ea8fbf32d748a8ad70996a9fa12843. Resources: {'cores', 'ram', 'instances'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:16:30.277064 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-7d6dc2f9-b7ce-404c-bea4-e756abbc535b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Getting quotas for user 9a671e0538ca45bbb44c298f1aa13a37 and project 85ea8fbf32d748a8ad70996a9fa12843. Resources: {'cores', 'ram', 'instances'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:16:30.293010 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-7d6dc2f9-b7ce-404c-bea4-e756abbc535b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Going to run 1 instances... {{(pid=117798) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:16:30.295418 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-7d6dc2f9-b7ce-404c-bea4-e756abbc535b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5b5a68b4-38e3-4f05-b97f-4339d6752e34',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:16:30.346222 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-7d6dc2f9-b7ce-404c-bea4-e756abbc535b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.630224 May 26 15:16:30.347857 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 341/715] 10.222.0.45 () {60 vars in 1146 bytes} [Thu May 26 15:16:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 15:16:30.361461 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-4094c307-ad05-47c9-9c45-5838e04801dc tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:30.362108 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-4094c307-ad05-47c9-9c45-5838e04801dc tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:30.364668 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:30.437074 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-4094c307-ad05-47c9-9c45-5838e04801dc tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:30.445319 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-4094c307-ad05-47c9-9c45-5838e04801dc tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6" status: 200 len: 1238 microversion: 2.1 time: 0.088223 May 26 15:16:30.445906 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 375/716] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:16:30 2022] GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6 => generated 1238 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:16:31.465928 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-70b8b548-23ad-4579-8040-e4787adb4e27 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:31.467328 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-70b8b548-23ad-4579-8040-e4787adb4e27 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:31.480386 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-70b8b548-23ad-4579-8040-e4787adb4e27 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:31.482169 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-70b8b548-23ad-4579-8040-e4787adb4e27 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:31.485409 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-70b8b548-23ad-4579-8040-e4787adb4e27 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:31.486955 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-70b8b548-23ad-4579-8040-e4787adb4e27 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:31.573767 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-70b8b548-23ad-4579-8040-e4787adb4e27 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:31.590812 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-70b8b548-23ad-4579-8040-e4787adb4e27 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6" status: 200 len: 1298 microversion: 2.1 time: 0.130263 May 26 15:16:31.604365 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 342/717] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:16:31 2022] GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6 => generated 1298 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:16:32.620651 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-f92ab9e1-c0b8-4839-b11f-84786d375eab tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:32.621980 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-f92ab9e1-c0b8-4839-b11f-84786d375eab tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:32.630236 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f92ab9e1-c0b8-4839-b11f-84786d375eab tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:32.630689 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f92ab9e1-c0b8-4839-b11f-84786d375eab tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:32.631682 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f92ab9e1-c0b8-4839-b11f-84786d375eab tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:32.631953 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f92ab9e1-c0b8-4839-b11f-84786d375eab tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:32.787216 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-f92ab9e1-c0b8-4839-b11f-84786d375eab tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:32.795454 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-f92ab9e1-c0b8-4839-b11f-84786d375eab tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6" status: 200 len: 1364 microversion: 2.1 time: 0.178860 May 26 15:16:32.796263 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 376/718] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:16:32 2022] GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6 => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:16:33.297519 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-d511495a-4a2e-4667-acc0-dc97f57ba1b1 req-6de981e7-b6df-4609-99a7-3ee085a9f7c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "183130d4-7caf-4ba9-a0d1-69e8187f36c6", "tag": "5907d8a5-d1b3-410e-9e64-143578f4b9e5"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:16:33.314647 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-d511495a-4a2e-4667-acc0-dc97f57ba1b1 req-6de981e7-b6df-4609-99a7-3ee085a9f7c4 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:33.315024 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-d511495a-4a2e-4667-acc0-dc97f57ba1b1 req-6de981e7-b6df-4609-99a7-3ee085a9f7c4 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:33.327068 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-d511495a-4a2e-4667-acc0-dc97f57ba1b1 req-6de981e7-b6df-4609-99a7-3ee085a9f7c4 service nova] Creating event network-changed:5907d8a5-d1b3-410e-9e64-143578f4b9e5 for instance 183130d4-7caf-4ba9-a0d1-69e8187f36c6 on hv-cinder-84301 May 26 15:16:33.334439 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-d511495a-4a2e-4667-acc0-dc97f57ba1b1 req-6de981e7-b6df-4609-99a7-3ee085a9f7c4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056064 May 26 15:16:33.335055 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 343/719] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:16:33.824035 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-ededb30b-80f7-4a08-83de-afaa4ee727aa tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:33.824748 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-ededb30b-80f7-4a08-83de-afaa4ee727aa tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:33.833540 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ededb30b-80f7-4a08-83de-afaa4ee727aa tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:33.834020 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ededb30b-80f7-4a08-83de-afaa4ee727aa tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:33.834784 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ededb30b-80f7-4a08-83de-afaa4ee727aa tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:33.835559 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ededb30b-80f7-4a08-83de-afaa4ee727aa tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:34.009740 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-ededb30b-80f7-4a08-83de-afaa4ee727aa tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:34.017282 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-ededb30b-80f7-4a08-83de-afaa4ee727aa tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6" status: 200 len: 1364 microversion: 2.1 time: 0.198396 May 26 15:16:34.017858 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 377/720] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:16:33 2022] GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6 => generated 1364 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:16:35.039042 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-42c1155d-3fae-406f-995c-70a49c023d09 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:35.039768 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-42c1155d-3fae-406f-995c-70a49c023d09 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:35.046056 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-42c1155d-3fae-406f-995c-70a49c023d09 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:35.046494 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-42c1155d-3fae-406f-995c-70a49c023d09 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:35.047280 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-42c1155d-3fae-406f-995c-70a49c023d09 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:35.047711 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-42c1155d-3fae-406f-995c-70a49c023d09 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:35.188040 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-42c1155d-3fae-406f-995c-70a49c023d09 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:35.195926 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-42c1155d-3fae-406f-995c-70a49c023d09 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6" status: 200 len: 1364 microversion: 2.1 time: 0.161543 May 26 15:16:35.196517 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 344/721] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:16:35 2022] GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:16:36.214430 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-a8bad29e-ffd5-4191-98ac-a25ce9b95b3b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:36.214975 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-a8bad29e-ffd5-4191-98ac-a25ce9b95b3b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:36.223040 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a8bad29e-ffd5-4191-98ac-a25ce9b95b3b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:36.223513 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a8bad29e-ffd5-4191-98ac-a25ce9b95b3b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:36.224297 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a8bad29e-ffd5-4191-98ac-a25ce9b95b3b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:36.224730 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a8bad29e-ffd5-4191-98ac-a25ce9b95b3b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:36.369897 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-a8bad29e-ffd5-4191-98ac-a25ce9b95b3b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:36.377667 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-a8bad29e-ffd5-4191-98ac-a25ce9b95b3b tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6" status: 200 len: 1364 microversion: 2.1 time: 0.167126 May 26 15:16:36.378269 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 378/722] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:16:36 2022] GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:16:37.397941 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-bd0442d2-14af-4933-b7cd-7991f108baca tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:37.398639 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-bd0442d2-14af-4933-b7cd-7991f108baca tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:37.408437 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bd0442d2-14af-4933-b7cd-7991f108baca tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:37.408983 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bd0442d2-14af-4933-b7cd-7991f108baca tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:37.409864 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bd0442d2-14af-4933-b7cd-7991f108baca tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:37.410302 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bd0442d2-14af-4933-b7cd-7991f108baca tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:37.612645 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-bd0442d2-14af-4933-b7cd-7991f108baca tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:37.620841 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-bd0442d2-14af-4933-b7cd-7991f108baca tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6" status: 200 len: 1364 microversion: 2.1 time: 0.229371 May 26 15:16:37.621559 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 345/723] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:16:37 2022] GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6 => generated 1364 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:16:38.638617 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-a6306217-5423-446b-b13f-d41abbcd3428 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:38.639290 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-a6306217-5423-446b-b13f-d41abbcd3428 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:38.647108 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a6306217-5423-446b-b13f-d41abbcd3428 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:38.647570 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a6306217-5423-446b-b13f-d41abbcd3428 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:38.648437 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a6306217-5423-446b-b13f-d41abbcd3428 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:38.648882 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a6306217-5423-446b-b13f-d41abbcd3428 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:38.796187 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-a6306217-5423-446b-b13f-d41abbcd3428 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:38.804946 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-a6306217-5423-446b-b13f-d41abbcd3428 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6" status: 200 len: 1364 microversion: 2.1 time: 0.170157 May 26 15:16:38.805628 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 379/724] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:16:38 2022] GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:16:39.823708 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-4f9dec48-c315-41c7-b5a5-7b9c0b30d6ef tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:39.824333 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-4f9dec48-c315-41c7-b5a5-7b9c0b30d6ef tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:39.832335 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4f9dec48-c315-41c7-b5a5-7b9c0b30d6ef tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:39.832786 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4f9dec48-c315-41c7-b5a5-7b9c0b30d6ef tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:39.833585 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4f9dec48-c315-41c7-b5a5-7b9c0b30d6ef tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:39.834016 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4f9dec48-c315-41c7-b5a5-7b9c0b30d6ef tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:39.944513 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-200c4fbc-06e0-4c2e-b0b5-b9001d3605b3 req-997c8b5b-2f5b-494c-b686-b88e92b59aef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "183130d4-7caf-4ba9-a0d1-69e8187f36c6", "name": "network-vif-plugged", "status": "completed", "tag": "5907d8a5-d1b3-410e-9e64-143578f4b9e5"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:16:39.960335 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-200c4fbc-06e0-4c2e-b0b5-b9001d3605b3 req-997c8b5b-2f5b-494c-b686-b88e92b59aef service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:39.961153 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-200c4fbc-06e0-4c2e-b0b5-b9001d3605b3 req-997c8b5b-2f5b-494c-b686-b88e92b59aef service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:39.990516 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-200c4fbc-06e0-4c2e-b0b5-b9001d3605b3 req-997c8b5b-2f5b-494c-b686-b88e92b59aef service nova] Creating event network-vif-plugged:5907d8a5-d1b3-410e-9e64-143578f4b9e5 for instance 183130d4-7caf-4ba9-a0d1-69e8187f36c6 on hv-cinder-84301 May 26 15:16:39.997873 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-200c4fbc-06e0-4c2e-b0b5-b9001d3605b3 req-997c8b5b-2f5b-494c-b686-b88e92b59aef service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058398 May 26 15:16:39.999140 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 380/725] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:16:40.044647 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-4f9dec48-c315-41c7-b5a5-7b9c0b30d6ef tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:40.055600 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-4f9dec48-c315-41c7-b5a5-7b9c0b30d6ef tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6" status: 200 len: 1364 microversion: 2.1 time: 0.236041 May 26 15:16:40.056464 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 346/726] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:16:39 2022] GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6 => generated 1364 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:16:41.070512 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell0:SELECT=6 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:41.075535 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-e6346726-1868-49e7-8dfa-07a74ffd8acf tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:41.076244 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-e6346726-1868-49e7-8dfa-07a74ffd8acf tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:41.083917 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e6346726-1868-49e7-8dfa-07a74ffd8acf tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:41.084366 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e6346726-1868-49e7-8dfa-07a74ffd8acf tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:41.085139 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e6346726-1868-49e7-8dfa-07a74ffd8acf tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:41.085588 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e6346726-1868-49e7-8dfa-07a74ffd8acf tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:41.230895 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-e6346726-1868-49e7-8dfa-07a74ffd8acf tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:41.242586 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-e6346726-1868-49e7-8dfa-07a74ffd8acf tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6" status: 200 len: 1364 microversion: 2.1 time: 0.172930 May 26 15:16:41.243631 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 381/727] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:16:41 2022] GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:16:42.294191 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-662c31f2-43c2-4537-98c2-9037fbd2f2e0 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:42.301231 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-662c31f2-43c2-4537-98c2-9037fbd2f2e0 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:42.303319 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=2 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:42.304106 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=6 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:42.307757 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:42.317131 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-662c31f2-43c2-4537-98c2-9037fbd2f2e0 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:42.317807 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-662c31f2-43c2-4537-98c2-9037fbd2f2e0 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:42.318615 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-662c31f2-43c2-4537-98c2-9037fbd2f2e0 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:42.319056 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-662c31f2-43c2-4537-98c2-9037fbd2f2e0 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:42.324104 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:42.567797 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-662c31f2-43c2-4537-98c2-9037fbd2f2e0 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:42.585717 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-662c31f2-43c2-4537-98c2-9037fbd2f2e0 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6" status: 200 len: 1364 microversion: 2.1 time: 0.324294 May 26 15:16:42.586832 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 347/728] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:16:42 2022] GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6 => generated 1364 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:16:43.608654 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-23b48499-d35d-4577-b1cd-98310d3c5ad7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:43.610925 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-23b48499-d35d-4577-b1cd-98310d3c5ad7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:43.624641 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-23b48499-d35d-4577-b1cd-98310d3c5ad7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:43.625092 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-23b48499-d35d-4577-b1cd-98310d3c5ad7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:43.626077 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-23b48499-d35d-4577-b1cd-98310d3c5ad7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:43.626577 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-23b48499-d35d-4577-b1cd-98310d3c5ad7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:43.631439 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:43.901338 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-23b48499-d35d-4577-b1cd-98310d3c5ad7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:43.911293 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-23b48499-d35d-4577-b1cd-98310d3c5ad7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6" status: 200 len: 1551 microversion: 2.1 time: 0.310083 May 26 15:16:43.911990 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 382/729] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:16:43 2022] GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6 => generated 1551 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:16:43.928757 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f691119e-6a2d-45ed-a903-04fa115ac60d tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:43.929888 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f691119e-6a2d-45ed-a903-04fa115ac60d tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:43.937891 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f691119e-6a2d-45ed-a903-04fa115ac60d tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:43.938626 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f691119e-6a2d-45ed-a903-04fa115ac60d tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:43.939644 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f691119e-6a2d-45ed-a903-04fa115ac60d tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:43.940269 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f691119e-6a2d-45ed-a903-04fa115ac60d tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:44.078497 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f691119e-6a2d-45ed-a903-04fa115ac60d tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.153811 May 26 15:16:44.079820 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 348/730] 10.222.0.45 () {58 vars in 1274 bytes} [Thu May 26 15:16:43 2022] GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6/os-interface => generated 285 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:16:45.585327 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-e2066865-fec7-4585-9fe7-f7da5b4b3460 req-ef86deaa-ab1a-471b-be81-9a910c609be3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "183130d4-7caf-4ba9-a0d1-69e8187f36c6", "tag": "5907d8a5-d1b3-410e-9e64-143578f4b9e5"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:16:45.603970 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-e2066865-fec7-4585-9fe7-f7da5b4b3460 req-ef86deaa-ab1a-471b-be81-9a910c609be3 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:45.607556 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-e2066865-fec7-4585-9fe7-f7da5b4b3460 req-ef86deaa-ab1a-471b-be81-9a910c609be3 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:45.636555 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-e2066865-fec7-4585-9fe7-f7da5b4b3460 req-ef86deaa-ab1a-471b-be81-9a910c609be3 service nova] Creating event network-changed:5907d8a5-d1b3-410e-9e64-143578f4b9e5 for instance 183130d4-7caf-4ba9-a0d1-69e8187f36c6 on hv-cinder-84301 May 26 15:16:45.647950 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-e2066865-fec7-4585-9fe7-f7da5b4b3460 req-ef86deaa-ab1a-471b-be81-9a910c609be3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066272 May 26 15:16:45.652864 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 383/731] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:16:51.987005 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b82044df-f8b5-4ab4-ad79-741494b6d9e7 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Action: 'create', calling method: .version_select at 0x7ffb5dda80d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1181214903", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUE22VgnCAfE7WiDPie+v2KVuLiI8GWgiAX7WtoQfAunlXWuaOUrOs0DWa5hW3eLDK4oj7U626zjRI1/yVmUsfVgW9X/bQmeQVGixPUbZfoLm38EjkFmAnCDoUZVkkk3g=="}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:16:52.005676 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-b82044df-f8b5-4ab4-ad79-741494b6d9e7 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Getting quotas for project 1da6b127a0d64f8892c4935ef08ed679. Resources: {'key_pairs'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:16:52.009514 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-b82044df-f8b5-4ab4-ad79-741494b6d9e7 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Getting quotas for user e55884035fd3441583ece37dd8eb9248 and project 1da6b127a0d64f8892c4935ef08ed679. Resources: {'key_pairs'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:16:52.041256 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b82044df-f8b5-4ab4-ad79-741494b6d9e7 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.226835 May 26 15:16:52.041885 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 349/732] 10.222.0.45 () {60 vars in 1158 bytes} [Thu May 26 15:16:51 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:17:27.375297 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_api:SELECT=19 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:17:27.376055 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=7 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:17:27.380880 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-e7f926dc-f62b-4e08-9976-4d06d0e34769 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-59059144", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1181214903", "security_groups": [{"name": "tempest-secgroup-smoke-986633093"}], "block_device_mapping_v2": [{"uuid": "3f27f095-f4f7-479d-bcd1-ee32dfea7d7f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "38936b65-04c9-4d68-a6df-607fd923b2aa"}]}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:17:27.501318 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.network.neutron [None req-e7f926dc-f62b-4e08-9976-4d06d0e34769 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] validate_networks() for [('38936b65-04c9-4d68-a6df-607fd923b2aa', None, None, None, None, None)] {{(pid=117799) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:17:27.878052 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-e7f926dc-f62b-4e08-9976-4d06d0e34769 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Flavor limits 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:17:27.878489 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-e7f926dc-f62b-4e08-9976-4d06d0e34769 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Image limits 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:17:27.879545 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-e7f926dc-f62b-4e08-9976-4d06d0e34769 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Flavor pref 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:17:27.879545 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-e7f926dc-f62b-4e08-9976-4d06d0e34769 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Image pref 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:17:27.880555 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-e7f926dc-f62b-4e08-9976-4d06d0e34769 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:17:27.895475 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e7f926dc-f62b-4e08-9976-4d06d0e34769 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:27.895927 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e7f926dc-f62b-4e08-9976-4d06d0e34769 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:27.896731 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e7f926dc-f62b-4e08-9976-4d06d0e34769 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:27.897180 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e7f926dc-f62b-4e08-9976-4d06d0e34769 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:27.915051 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.quota [None req-e7f926dc-f62b-4e08-9976-4d06d0e34769 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Getting quotas for project 1da6b127a0d64f8892c4935ef08ed679. Resources: {'cores', 'ram', 'instances'} {{(pid=117799) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:17:27.919038 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.quota [None req-e7f926dc-f62b-4e08-9976-4d06d0e34769 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Getting quotas for user e55884035fd3441583ece37dd8eb9248 and project 1da6b127a0d64f8892c4935ef08ed679. Resources: {'cores', 'ram', 'instances'} {{(pid=117799) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:17:27.981882 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-e7f926dc-f62b-4e08-9976-4d06d0e34769 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Going to run 1 instances... {{(pid=117799) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:17:27.984094 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-e7f926dc-f62b-4e08-9976-4d06d0e34769 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 612ae9ec-d528-4264-afd3-373c904f50fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3f27f095-f4f7-479d-bcd1-ee32dfea7d7f',volume_size=None,volume_type=None)] {{(pid=117799) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:17:28.130327 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-e7f926dc-f62b-4e08-9976-4d06d0e34769 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.756567 May 26 15:17:28.130875 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 384/733] 10.222.0.45 () {60 vars in 1146 bytes} [Thu May 26 15:17:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 15:17:28.138339 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=9 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:17:28.139304 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=4 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:17:28.139812 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:17:28.144891 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c90439ae-d396-465d-83ba-30d54995f4e0 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:28.145502 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c90439ae-d396-465d-83ba-30d54995f4e0 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 612ae9ec-d528-4264-afd3-373c904f50fd] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:28.205177 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c90439ae-d396-465d-83ba-30d54995f4e0 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:17:28.217367 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c90439ae-d396-465d-83ba-30d54995f4e0 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd" status: 200 len: 1093 microversion: 2.1 time: 0.080092 May 26 15:17:28.218453 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 350/734] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:17:28 2022] GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd => generated 1093 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:17:29.235059 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-f039603d-fc71-4ef3-93d9-d0d18393fe69 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:29.235695 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-f039603d-fc71-4ef3-93d9-d0d18393fe69 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 612ae9ec-d528-4264-afd3-373c904f50fd] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:29.242986 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f039603d-fc71-4ef3-93d9-d0d18393fe69 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:29.243465 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f039603d-fc71-4ef3-93d9-d0d18393fe69 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:29.244229 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f039603d-fc71-4ef3-93d9-d0d18393fe69 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:29.244663 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f039603d-fc71-4ef3-93d9-d0d18393fe69 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:29.311876 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-f039603d-fc71-4ef3-93d9-d0d18393fe69 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:17:29.320307 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-f039603d-fc71-4ef3-93d9-d0d18393fe69 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd" status: 200 len: 1191 microversion: 2.1 time: 0.089102 May 26 15:17:29.330313 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 385/735] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:17:29 2022] GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd => generated 1191 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:17:30.338036 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f7571cb4-dcb4-4191-abf3-a06cd51d412a tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:30.338639 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f7571cb4-dcb4-4191-abf3-a06cd51d412a tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 612ae9ec-d528-4264-afd3-373c904f50fd] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:30.346858 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f7571cb4-dcb4-4191-abf3-a06cd51d412a tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:30.347591 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f7571cb4-dcb4-4191-abf3-a06cd51d412a tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:30.348366 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f7571cb4-dcb4-4191-abf3-a06cd51d412a tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:30.348798 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f7571cb4-dcb4-4191-abf3-a06cd51d412a tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:30.555970 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f7571cb4-dcb4-4191-abf3-a06cd51d412a tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:17:30.563523 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f7571cb4-dcb4-4191-abf3-a06cd51d412a tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd" status: 200 len: 1264 microversion: 2.1 time: 0.229378 May 26 15:17:30.564129 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 351/736] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:17:30 2022] GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd => generated 1264 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:17:30.877444 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-b1c394b5-cd99-470a-92da-09ae66265aab req-f55f6cb7-4a0e-47cd-b56f-b4960445f79c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "612ae9ec-d528-4264-afd3-373c904f50fd", "tag": "ef765667-706d-434f-bd38-174e92d9e085"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:17:30.887694 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-b1c394b5-cd99-470a-92da-09ae66265aab req-f55f6cb7-4a0e-47cd-b56f-b4960445f79c service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:30.888314 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-b1c394b5-cd99-470a-92da-09ae66265aab req-f55f6cb7-4a0e-47cd-b56f-b4960445f79c service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:30.914733 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-b1c394b5-cd99-470a-92da-09ae66265aab req-f55f6cb7-4a0e-47cd-b56f-b4960445f79c service nova] Creating event network-changed:ef765667-706d-434f-bd38-174e92d9e085 for instance 612ae9ec-d528-4264-afd3-373c904f50fd on hv-cinder-84301 May 26 15:17:30.919681 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-b1c394b5-cd99-470a-92da-09ae66265aab req-f55f6cb7-4a0e-47cd-b56f-b4960445f79c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045941 May 26 15:17:30.920495 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 386/737] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:17:31.580976 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-72ac1543-8ec9-462e-bd33-a80054a62d08 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:31.581571 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-72ac1543-8ec9-462e-bd33-a80054a62d08 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 612ae9ec-d528-4264-afd3-373c904f50fd] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:31.588287 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-72ac1543-8ec9-462e-bd33-a80054a62d08 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:31.588726 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-72ac1543-8ec9-462e-bd33-a80054a62d08 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:31.589491 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-72ac1543-8ec9-462e-bd33-a80054a62d08 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:31.589920 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-72ac1543-8ec9-462e-bd33-a80054a62d08 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:31.723468 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-72ac1543-8ec9-462e-bd33-a80054a62d08 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:17:31.730951 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-72ac1543-8ec9-462e-bd33-a80054a62d08 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd" status: 200 len: 1264 microversion: 2.1 time: 0.153996 May 26 15:17:31.731551 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 352/738] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:17:31 2022] GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:17:32.749544 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-70ae1b81-bc83-4861-8161-3f3551496002 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:32.750249 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-70ae1b81-bc83-4861-8161-3f3551496002 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 612ae9ec-d528-4264-afd3-373c904f50fd] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:32.756723 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-70ae1b81-bc83-4861-8161-3f3551496002 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:32.757175 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-70ae1b81-bc83-4861-8161-3f3551496002 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:32.757955 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-70ae1b81-bc83-4861-8161-3f3551496002 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:32.758419 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-70ae1b81-bc83-4861-8161-3f3551496002 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:32.966015 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-70ae1b81-bc83-4861-8161-3f3551496002 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:17:32.974410 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-70ae1b81-bc83-4861-8161-3f3551496002 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd" status: 200 len: 1264 microversion: 2.1 time: 0.229551 May 26 15:17:32.975000 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 387/739] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:17:32 2022] GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd => generated 1264 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:17:33.992506 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-0c8c3a88-2a35-4cfb-8f9f-fcdd1901ff5a tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:33.993105 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-0c8c3a88-2a35-4cfb-8f9f-fcdd1901ff5a tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 612ae9ec-d528-4264-afd3-373c904f50fd] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:34.000031 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0c8c3a88-2a35-4cfb-8f9f-fcdd1901ff5a tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:34.000480 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0c8c3a88-2a35-4cfb-8f9f-fcdd1901ff5a tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:34.001256 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0c8c3a88-2a35-4cfb-8f9f-fcdd1901ff5a tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:34.001727 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0c8c3a88-2a35-4cfb-8f9f-fcdd1901ff5a tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:34.143579 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-0c8c3a88-2a35-4cfb-8f9f-fcdd1901ff5a tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:17:34.151284 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-0c8c3a88-2a35-4cfb-8f9f-fcdd1901ff5a tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd" status: 200 len: 1264 microversion: 2.1 time: 0.162534 May 26 15:17:34.151863 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 353/740] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:17:33 2022] GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:17:35.168655 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-c04329db-58f8-4ddb-a02c-a4ea04db19d6 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:35.169270 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-c04329db-58f8-4ddb-a02c-a4ea04db19d6 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 612ae9ec-d528-4264-afd3-373c904f50fd] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:35.176727 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c04329db-58f8-4ddb-a02c-a4ea04db19d6 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:35.177348 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c04329db-58f8-4ddb-a02c-a4ea04db19d6 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:35.178146 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c04329db-58f8-4ddb-a02c-a4ea04db19d6 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:35.178561 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c04329db-58f8-4ddb-a02c-a4ea04db19d6 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:35.309803 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-c04329db-58f8-4ddb-a02c-a4ea04db19d6 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:17:35.317957 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-c04329db-58f8-4ddb-a02c-a4ea04db19d6 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd" status: 200 len: 1264 microversion: 2.1 time: 0.153255 May 26 15:17:35.318526 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 388/741] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:17:35 2022] GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:17:36.334525 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-5754cbc4-8fe4-4c52-844e-7f23900b1cd2 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:36.335065 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-5754cbc4-8fe4-4c52-844e-7f23900b1cd2 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 612ae9ec-d528-4264-afd3-373c904f50fd] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:36.341484 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5754cbc4-8fe4-4c52-844e-7f23900b1cd2 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:36.341933 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5754cbc4-8fe4-4c52-844e-7f23900b1cd2 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:36.342701 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5754cbc4-8fe4-4c52-844e-7f23900b1cd2 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:36.343165 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5754cbc4-8fe4-4c52-844e-7f23900b1cd2 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:36.475958 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-5754cbc4-8fe4-4c52-844e-7f23900b1cd2 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:17:36.483242 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-5754cbc4-8fe4-4c52-844e-7f23900b1cd2 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd" status: 200 len: 1264 microversion: 2.1 time: 0.153332 May 26 15:17:36.483808 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 354/742] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:17:36 2022] GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:17:37.499840 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-30b3bd96-01a6-4438-b31b-9818527201ab tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:37.500449 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-30b3bd96-01a6-4438-b31b-9818527201ab tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 612ae9ec-d528-4264-afd3-373c904f50fd] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:37.507595 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-30b3bd96-01a6-4438-b31b-9818527201ab tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:37.508044 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-30b3bd96-01a6-4438-b31b-9818527201ab tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:37.508803 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-30b3bd96-01a6-4438-b31b-9818527201ab tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:37.509238 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-30b3bd96-01a6-4438-b31b-9818527201ab tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:37.637937 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-30b3bd96-01a6-4438-b31b-9818527201ab tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:17:37.645843 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-30b3bd96-01a6-4438-b31b-9818527201ab tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd" status: 200 len: 1264 microversion: 2.1 time: 0.149861 May 26 15:17:37.646407 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 389/743] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:17:37 2022] GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:17:38.662870 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e5f9db18-f5eb-42d3-8524-4adaee50fa17 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:38.663493 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e5f9db18-f5eb-42d3-8524-4adaee50fa17 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 612ae9ec-d528-4264-afd3-373c904f50fd] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:38.665794 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=2 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:17:38.671179 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e5f9db18-f5eb-42d3-8524-4adaee50fa17 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:38.671623 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e5f9db18-f5eb-42d3-8524-4adaee50fa17 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:38.672375 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e5f9db18-f5eb-42d3-8524-4adaee50fa17 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:38.672799 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e5f9db18-f5eb-42d3-8524-4adaee50fa17 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:38.803967 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e5f9db18-f5eb-42d3-8524-4adaee50fa17 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:17:38.811406 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e5f9db18-f5eb-42d3-8524-4adaee50fa17 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd" status: 200 len: 1264 microversion: 2.1 time: 0.152894 May 26 15:17:38.811972 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 355/744] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:17:38 2022] GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:17:39.827823 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-b81971b5-f2e3-4b97-aa6b-514f7a7bbdbb tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:39.828477 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-b81971b5-f2e3-4b97-aa6b-514f7a7bbdbb tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 612ae9ec-d528-4264-afd3-373c904f50fd] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:39.830922 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell0:SELECT=2 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:17:39.831928 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell0:SELECT=6 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:17:39.838567 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b81971b5-f2e3-4b97-aa6b-514f7a7bbdbb tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:39.839022 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b81971b5-f2e3-4b97-aa6b-514f7a7bbdbb tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:39.839817 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b81971b5-f2e3-4b97-aa6b-514f7a7bbdbb tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:39.840255 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b81971b5-f2e3-4b97-aa6b-514f7a7bbdbb tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:39.977394 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-b81971b5-f2e3-4b97-aa6b-514f7a7bbdbb tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:17:39.984762 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-b81971b5-f2e3-4b97-aa6b-514f7a7bbdbb tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd" status: 200 len: 1264 microversion: 2.1 time: 0.160801 May 26 15:17:39.985327 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 390/745] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:17:39 2022] GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:17:41.003859 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-90d39d52-8197-44af-a013-df64c76ac2ec tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:41.004474 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-90d39d52-8197-44af-a013-df64c76ac2ec tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 612ae9ec-d528-4264-afd3-373c904f50fd] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:41.010493 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-90d39d52-8197-44af-a013-df64c76ac2ec tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:41.010943 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-90d39d52-8197-44af-a013-df64c76ac2ec tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:41.011778 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-90d39d52-8197-44af-a013-df64c76ac2ec tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:41.012215 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-90d39d52-8197-44af-a013-df64c76ac2ec tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:41.142261 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-90d39d52-8197-44af-a013-df64c76ac2ec tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:17:41.150188 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-90d39d52-8197-44af-a013-df64c76ac2ec tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd" status: 200 len: 1264 microversion: 2.1 time: 0.152494 May 26 15:17:41.150754 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 356/746] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:17:40 2022] GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:17:42.167461 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-4a6d9a70-f886-4f41-a0a7-c6caf1710a75 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:42.168099 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-4a6d9a70-f886-4f41-a0a7-c6caf1710a75 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 612ae9ec-d528-4264-afd3-373c904f50fd] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:42.174703 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4a6d9a70-f886-4f41-a0a7-c6caf1710a75 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:42.175183 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4a6d9a70-f886-4f41-a0a7-c6caf1710a75 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:42.176244 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4a6d9a70-f886-4f41-a0a7-c6caf1710a75 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:42.176524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4a6d9a70-f886-4f41-a0a7-c6caf1710a75 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:42.315569 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-4a6d9a70-f886-4f41-a0a7-c6caf1710a75 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:17:42.322981 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-4a6d9a70-f886-4f41-a0a7-c6caf1710a75 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd" status: 200 len: 1264 microversion: 2.1 time: 0.159377 May 26 15:17:42.323573 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 391/747] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:17:42 2022] GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:17:43.340817 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-99f88745-5e8b-41c3-b521-b19be0b3ae92 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:43.341373 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-99f88745-5e8b-41c3-b521-b19be0b3ae92 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 612ae9ec-d528-4264-afd3-373c904f50fd] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:43.348391 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-99f88745-5e8b-41c3-b521-b19be0b3ae92 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:43.348833 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-99f88745-5e8b-41c3-b521-b19be0b3ae92 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:43.349585 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-99f88745-5e8b-41c3-b521-b19be0b3ae92 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:43.350021 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-99f88745-5e8b-41c3-b521-b19be0b3ae92 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:43.481640 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-99f88745-5e8b-41c3-b521-b19be0b3ae92 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:17:43.489184 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-99f88745-5e8b-41c3-b521-b19be0b3ae92 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd" status: 200 len: 1264 microversion: 2.1 time: 0.152339 May 26 15:17:43.489741 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 357/748] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:17:43 2022] GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:17:44.173521 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-44ed1179-945c-4628-a5e0-41a06ef706b1 req-6c4b2f39-ec65-4726-b50e-ebb3fd264f60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "612ae9ec-d528-4264-afd3-373c904f50fd", "name": "network-vif-plugged", "status": "completed", "tag": "ef765667-706d-434f-bd38-174e92d9e085"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:17:44.183566 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-44ed1179-945c-4628-a5e0-41a06ef706b1 req-6c4b2f39-ec65-4726-b50e-ebb3fd264f60 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:44.184072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-44ed1179-945c-4628-a5e0-41a06ef706b1 req-6c4b2f39-ec65-4726-b50e-ebb3fd264f60 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:44.198026 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-44ed1179-945c-4628-a5e0-41a06ef706b1 req-6c4b2f39-ec65-4726-b50e-ebb3fd264f60 service nova] Creating event network-vif-plugged:ef765667-706d-434f-bd38-174e92d9e085 for instance 612ae9ec-d528-4264-afd3-373c904f50fd on hv-cinder-84301 May 26 15:17:44.203742 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-44ed1179-945c-4628-a5e0-41a06ef706b1 req-6c4b2f39-ec65-4726-b50e-ebb3fd264f60 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033904 May 26 15:17:44.204299 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 392/749] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:17:44.505492 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-2b2e00cc-877a-4b83-b42d-b52d6b8a2f1f tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:44.506156 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-2b2e00cc-877a-4b83-b42d-b52d6b8a2f1f tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 612ae9ec-d528-4264-afd3-373c904f50fd] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:44.512843 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2b2e00cc-877a-4b83-b42d-b52d6b8a2f1f tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:44.513246 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2b2e00cc-877a-4b83-b42d-b52d6b8a2f1f tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:44.514016 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2b2e00cc-877a-4b83-b42d-b52d6b8a2f1f tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:44.514450 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2b2e00cc-877a-4b83-b42d-b52d6b8a2f1f tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:44.702397 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2b2e00cc-877a-4b83-b42d-b52d6b8a2f1f tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:17:44.710675 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-2b2e00cc-877a-4b83-b42d-b52d6b8a2f1f tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd" status: 200 len: 1264 microversion: 2.1 time: 0.209168 May 26 15:17:44.711335 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 358/750] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:17:44 2022] GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd => generated 1264 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:17:45.728488 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-2caefe10-0015-42d1-9d23-947cb88f035b tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:45.729220 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-2caefe10-0015-42d1-9d23-947cb88f035b tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 612ae9ec-d528-4264-afd3-373c904f50fd] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:45.735874 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2caefe10-0015-42d1-9d23-947cb88f035b tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:45.736417 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2caefe10-0015-42d1-9d23-947cb88f035b tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:45.737407 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2caefe10-0015-42d1-9d23-947cb88f035b tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:45.737840 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2caefe10-0015-42d1-9d23-947cb88f035b tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:45.879071 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-2caefe10-0015-42d1-9d23-947cb88f035b tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:17:45.886614 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-2caefe10-0015-42d1-9d23-947cb88f035b tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd" status: 200 len: 1264 microversion: 2.1 time: 0.162318 May 26 15:17:45.887207 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 393/751] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:17:45 2022] GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:17:46.905144 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-7321a708-b17b-43cd-8dc8-d67b870286ea tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:46.905744 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-7321a708-b17b-43cd-8dc8-d67b870286ea tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 612ae9ec-d528-4264-afd3-373c904f50fd] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:46.913599 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7321a708-b17b-43cd-8dc8-d67b870286ea tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:46.914049 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7321a708-b17b-43cd-8dc8-d67b870286ea tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:46.914814 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7321a708-b17b-43cd-8dc8-d67b870286ea tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:46.915266 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7321a708-b17b-43cd-8dc8-d67b870286ea tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:47.096465 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7321a708-b17b-43cd-8dc8-d67b870286ea tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:17:47.105134 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-7321a708-b17b-43cd-8dc8-d67b870286ea tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd" status: 200 len: 1264 microversion: 2.1 time: 0.204397 May 26 15:17:47.105722 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 359/752] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:17:46 2022] GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd => generated 1264 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:17:48.122032 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-92c31714-d981-431a-997f-f126db6c5b7c tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:48.122635 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-92c31714-d981-431a-997f-f126db6c5b7c tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 612ae9ec-d528-4264-afd3-373c904f50fd] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:48.129331 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-92c31714-d981-431a-997f-f126db6c5b7c tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:48.129783 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-92c31714-d981-431a-997f-f126db6c5b7c tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:48.130553 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-92c31714-d981-431a-997f-f126db6c5b7c tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:48.130996 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-92c31714-d981-431a-997f-f126db6c5b7c tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:48.264151 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-92c31714-d981-431a-997f-f126db6c5b7c tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:17:48.272437 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-92c31714-d981-431a-997f-f126db6c5b7c tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd" status: 200 len: 1451 microversion: 2.1 time: 0.154489 May 26 15:17:48.273007 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 394/753] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:17:48 2022] GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:17:48.288455 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-828e75e4-895a-4f5a-9f50-d1c9eeff12ef tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:48.289060 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-828e75e4-895a-4f5a-9f50-d1c9eeff12ef tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 612ae9ec-d528-4264-afd3-373c904f50fd] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:48.295927 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-828e75e4-895a-4f5a-9f50-d1c9eeff12ef tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:48.296309 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-828e75e4-895a-4f5a-9f50-d1c9eeff12ef tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:48.297069 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-828e75e4-895a-4f5a-9f50-d1c9eeff12ef tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:48.297499 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-828e75e4-895a-4f5a-9f50-d1c9eeff12ef tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:48.433896 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-828e75e4-895a-4f5a-9f50-d1c9eeff12ef tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:17:48.441912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-828e75e4-895a-4f5a-9f50-d1c9eeff12ef tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd" status: 200 len: 1451 microversion: 2.1 time: 0.157607 May 26 15:17:48.442483 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 360/754] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:17:48 2022] GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:17:50.291972 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-25cb7746-6aef-4036-82eb-5e472fbae8ed req-5ecc8e6e-cbd6-42e1-a609-77ad57339a3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "612ae9ec-d528-4264-afd3-373c904f50fd", "tag": "ef765667-706d-434f-bd38-174e92d9e085"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:17:50.301193 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-25cb7746-6aef-4036-82eb-5e472fbae8ed req-5ecc8e6e-cbd6-42e1-a609-77ad57339a3e service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:50.301636 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-25cb7746-6aef-4036-82eb-5e472fbae8ed req-5ecc8e6e-cbd6-42e1-a609-77ad57339a3e service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:50.313745 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-25cb7746-6aef-4036-82eb-5e472fbae8ed req-5ecc8e6e-cbd6-42e1-a609-77ad57339a3e service nova] Creating event network-changed:ef765667-706d-434f-bd38-174e92d9e085 for instance 612ae9ec-d528-4264-afd3-373c904f50fd on hv-cinder-84301 May 26 15:17:50.319061 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-25cb7746-6aef-4036-82eb-5e472fbae8ed req-5ecc8e6e-cbd6-42e1-a609-77ad57339a3e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030969 May 26 15:17:50.319699 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 395/755] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:17:53.591721 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-3405bda0-932d-43e4-81ef-ee5867eb62d3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:53.592277 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-3405bda0-932d-43e4-81ef-ee5867eb62d3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 819b82d5-9c2d-4302-a0ad-ba9f20cac568] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:53.600039 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3405bda0-932d-43e4-81ef-ee5867eb62d3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:53.600475 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3405bda0-932d-43e4-81ef-ee5867eb62d3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:53.601228 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3405bda0-932d-43e4-81ef-ee5867eb62d3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:53.601649 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3405bda0-932d-43e4-81ef-ee5867eb62d3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:53.625109 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-3405bda0-932d-43e4-81ef-ee5867eb62d3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568/ips" status: 200 len: 149 microversion: 2.1 time: 0.037218 May 26 15:17:53.625662 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 361/756] 10.222.0.45 () {58 vars in 1247 bytes} [Thu May 26 15:17:53 2022] GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:17:55.988230 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-203259a7-fa67-40eb-a0fb-e0340f4dacb6 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b8590f34-352d-4a9c-8fa4-0dd27fb616f8"}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:17:55.989353 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-203259a7-fa67-40eb-a0fb-e0340f4dacb6 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 819b82d5-9c2d-4302-a0ad-ba9f20cac568] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:55.995518 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-203259a7-fa67-40eb-a0fb-e0340f4dacb6 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:55.995960 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-203259a7-fa67-40eb-a0fb-e0340f4dacb6 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:55.996711 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-203259a7-fa67-40eb-a0fb-e0340f4dacb6 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:55.997144 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-203259a7-fa67-40eb-a0fb-e0340f4dacb6 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:56.235495 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-203259a7-fa67-40eb-a0fb-e0340f4dacb6 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "POST /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252300 May 26 15:17:56.237061 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 396/757] 10.222.0.45 () {60 vars in 1322 bytes} [Thu May 26 15:17:55 2022] POST /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:17:58.011137 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-4ed03cf9-f466-4f54-a188-f059d0cd31e0 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:58.011709 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-4ed03cf9-f466-4f54-a188-f059d0cd31e0 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:58.011909 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-124b57a6-1fb6-48d5-b356-0ab80b284a26 req-d1bf1f56-cb79-483c-9c6e-6ee05545c336 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e1f09bd-1e01-460e-be13-9b1749b27926", "tag": "6a458fb5-32cd-48f8-8aa2-9f2629863eb3"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:17:58.019728 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4ed03cf9-f466-4f54-a188-f059d0cd31e0 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:58.020290 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4ed03cf9-f466-4f54-a188-f059d0cd31e0 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:58.021298 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4ed03cf9-f466-4f54-a188-f059d0cd31e0 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:58.021421 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:17:58.021808 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4ed03cf9-f466-4f54-a188-f059d0cd31e0 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:58.023687 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-124b57a6-1fb6-48d5-b356-0ab80b284a26 req-d1bf1f56-cb79-483c-9c6e-6ee05545c336 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:58.024177 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-124b57a6-1fb6-48d5-b356-0ab80b284a26 req-d1bf1f56-cb79-483c-9c6e-6ee05545c336 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:58.040398 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:17:58.043200 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-124b57a6-1fb6-48d5-b356-0ab80b284a26 req-d1bf1f56-cb79-483c-9c6e-6ee05545c336 service nova] Creating event network-changed:6a458fb5-32cd-48f8-8aa2-9f2629863eb3 for instance 4e1f09bd-1e01-460e-be13-9b1749b27926 on hv-cinder-84301 May 26 15:17:58.049406 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-124b57a6-1fb6-48d5-b356-0ab80b284a26 req-d1bf1f56-cb79-483c-9c6e-6ee05545c336 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041862 May 26 15:17:58.050193 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 397/758] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:17:58.050882 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-4ed03cf9-f466-4f54-a188-f059d0cd31e0 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Going to try to terminate instance {{(pid=117798) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:17:58.140598 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-4ed03cf9-f466-4f54-a188-f059d0cd31e0 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 204 len: 0 microversion: 2.1 time: 0.132981 May 26 15:17:58.146174 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 362/759] 10.222.0.45 () {58 vars in 1238 bytes} [Thu May 26 15:17:58 2022] DELETE /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:17:58.155021 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-09251fea-2988-42c7-900e-7466102084db tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:58.155746 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-09251fea-2988-42c7-900e-7466102084db tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:58.164234 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-09251fea-2988-42c7-900e-7466102084db tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:58.165394 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-09251fea-2988-42c7-900e-7466102084db tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:58.166186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-09251fea-2988-42c7-900e-7466102084db tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:58.166629 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-09251fea-2988-42c7-900e-7466102084db tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:58.325639 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-09251fea-2988-42c7-900e-7466102084db tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:17:58.333512 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-09251fea-2988-42c7-900e-7466102084db tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1567 microversion: 2.1 time: 0.185737 May 26 15:17:58.334094 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 398/760] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:17:58 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:17:59.352374 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-84203a91-c0f1-4452-9134-7298cadb1876 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:59.353160 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-84203a91-c0f1-4452-9134-7298cadb1876 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:59.355589 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:17:59.360830 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-84203a91-c0f1-4452-9134-7298cadb1876 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:59.361293 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-84203a91-c0f1-4452-9134-7298cadb1876 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:59.362556 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-84203a91-c0f1-4452-9134-7298cadb1876 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:59.363172 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-84203a91-c0f1-4452-9134-7298cadb1876 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:59.368024 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:17:59.501505 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-84203a91-c0f1-4452-9134-7298cadb1876 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:17:59.510363 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-84203a91-c0f1-4452-9134-7298cadb1876 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1567 microversion: 2.1 time: 0.162354 May 26 15:17:59.510947 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 363/761] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:17:59 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:00.527828 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-e081f9cb-4c83-46cc-91f4-6d1712d1c019 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:00.528437 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-e081f9cb-4c83-46cc-91f4-6d1712d1c019 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:00.535696 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e081f9cb-4c83-46cc-91f4-6d1712d1c019 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:00.536143 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e081f9cb-4c83-46cc-91f4-6d1712d1c019 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:00.536917 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e081f9cb-4c83-46cc-91f4-6d1712d1c019 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:00.537350 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e081f9cb-4c83-46cc-91f4-6d1712d1c019 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:00.724840 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-e081f9cb-4c83-46cc-91f4-6d1712d1c019 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:00.732515 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-e081f9cb-4c83-46cc-91f4-6d1712d1c019 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1448 microversion: 2.1 time: 0.208562 May 26 15:18:00.733117 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 399/762] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:18:00 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1448 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:00.957307 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-f4c12d5d-4314-4e44-8419-e55c0f0eee2a req-e4c97e40-bb4c-4470-9a74-8aca0ddf1b60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1f09bd-1e01-460e-be13-9b1749b27926", "name": "network-vif-deleted", "tag": "6a458fb5-32cd-48f8-8aa2-9f2629863eb3"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:18:00.966854 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-f4c12d5d-4314-4e44-8419-e55c0f0eee2a req-e4c97e40-bb4c-4470-9a74-8aca0ddf1b60 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:00.967327 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-f4c12d5d-4314-4e44-8419-e55c0f0eee2a req-e4c97e40-bb4c-4470-9a74-8aca0ddf1b60 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:00.978861 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-f4c12d5d-4314-4e44-8419-e55c0f0eee2a req-e4c97e40-bb4c-4470-9a74-8aca0ddf1b60 service nova] Creating event network-vif-deleted:6a458fb5-32cd-48f8-8aa2-9f2629863eb3 for instance 4e1f09bd-1e01-460e-be13-9b1749b27926 on hv-cinder-84301 May 26 15:18:00.984203 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-f4c12d5d-4314-4e44-8419-e55c0f0eee2a req-e4c97e40-bb4c-4470-9a74-8aca0ddf1b60 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030677 May 26 15:18:00.984995 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 364/763] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:18:01.750290 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-f563b2e1-0343-4ebe-a1a0-a4211e44a8b7 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:01.750970 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-f563b2e1-0343-4ebe-a1a0-a4211e44a8b7 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:01.758399 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f563b2e1-0343-4ebe-a1a0-a4211e44a8b7 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:01.758921 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f563b2e1-0343-4ebe-a1a0-a4211e44a8b7 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:01.759723 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f563b2e1-0343-4ebe-a1a0-a4211e44a8b7 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:01.760236 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f563b2e1-0343-4ebe-a1a0-a4211e44a8b7 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:01.793073 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f563b2e1-0343-4ebe-a1a0-a4211e44a8b7 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:01.793424 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f563b2e1-0343-4ebe-a1a0-a4211e44a8b7 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:01.793868 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.objects.instance [None req-f563b2e1-0343-4ebe-a1a0-a4211e44a8b7 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lazy-loading 'fault' on Instance uuid 4e1f09bd-1e01-460e-be13-9b1749b27926 {{(pid=117799) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:18:01.834673 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-f563b2e1-0343-4ebe-a1a0-a4211e44a8b7 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c861e4c9be0b4e7ab86df8ec362013f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070367cab3334be48e0644598d755492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:01.842172 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-f563b2e1-0343-4ebe-a1a0-a4211e44a8b7 tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 200 len: 1224 microversion: 2.1 time: 0.096048 May 26 15:18:01.842739 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 400/764] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:18:01 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:02.860738 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b003941d-c030-445f-bebb-bc6a07f0af0c tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:02.861355 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b003941d-c030-445f-bebb-bc6a07f0af0c tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] [instance: 4e1f09bd-1e01-460e-be13-9b1749b27926] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:02.867967 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b003941d-c030-445f-bebb-bc6a07f0af0c tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:02.868415 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b003941d-c030-445f-bebb-bc6a07f0af0c tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:02.869180 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b003941d-c030-445f-bebb-bc6a07f0af0c tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:02.869617 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b003941d-c030-445f-bebb-bc6a07f0af0c tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:02.883195 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-b003941d-c030-445f-bebb-bc6a07f0af0c tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] HTTP exception thrown: Instance 4e1f09bd-1e01-460e-be13-9b1749b27926 could not be found. May 26 15:18:02.884894 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b003941d-c030-445f-bebb-bc6a07f0af0c tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Request method failure captured: May 26 15:18:02.884894 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: request: GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 HTTP/1.1 May 26 15:18:02.884894 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept: application/json May 26 15:18:02.884894 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity May 26 15:18:02.884894 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Connection: close May 26 15:18:02.884894 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Length: 0 May 26 15:18:02.884894 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Type: application/json May 26 15:18:02.884894 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Host: 10.222.0.45 May 26 15:18:02.884894 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None May 26 15:18:02.884894 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 May 26 15:18:02.884894 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABij5ihFbg9ryVpR3AuJIqsx8H54OhpyX5tvJXyc0uDlYyRE4tKjPMCazF7K2U9WORazOOTEc_k1oKmu99ceajWjHzxdXM5WHCAqsuqhHfOLkeWeMKe7wxQQBNCGbcQS_6FK4XE8k5W_l80XnRhj4d9f0gZ-Z2dFo6IYx7g7aELuZX4cMc May 26 15:18:02.884894 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Id: None May 26 15:18:02.884894 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Name: None May 26 15:18:02.884894 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed May 26 15:18:02.884894 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True May 26 15:18:02.884894 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default May 26 15:18:02.884894 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default May 26 15:18:02.884894 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Id: 070367cab3334be48e0644598d755492 May 26 15:18:02.884894 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-TestShelveInstance-1347246375 May 26 15:18:02.884894 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Role: reader,member May 26 15:18:02.884894 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Roles: reader,member May 26 15:18:02.886464 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/070367cab3334be48e0644598d755492"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/070367cab3334be48e0644598d755492"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/070367cab3334be48e0644598d755492"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_070367cab3334be48e0644598d755492"}]}] May 26 15:18:02.886464 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-TestShelveInstance-1347246375 May 26 15:18:02.886464 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Id: 070367cab3334be48e0644598d755492 May 26 15:18:02.886464 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-TestShelveInstance-1347246375 May 26 15:18:02.886464 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User: tempest-TestShelveInstance-1347246375-project May 26 15:18:02.886464 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default May 26 15:18:02.886464 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default May 26 15:18:02.886464 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Id: c861e4c9be0b4e7ab86df8ec362013f1 May 26 15:18:02.886464 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-TestShelveInstance-1347246375-project May 26 15:18:02.886464 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: method: > May 26 15:18:02.886464 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: exception: Instance 4e1f09bd-1e01-460e-be13-9b1749b27926 could not be found. May 26 15:18:02.886464 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: action_args: {'id': '4e1f09bd-1e01-460e-be13-9b1749b27926'} May 26 15:18:02.887367 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:18:02.887367 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:18:02.887367 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:18:02.887367 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:18:02.887367 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:18:02.887367 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:18:02.887367 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:18:02.887367 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:18:02.887367 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:18:02.887367 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:18:02.887367 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e1f09bd-1e01-460e-be13-9b1749b27926 could not be found. May 26 15:18:02.887367 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:18:02.887367 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:18:02.887367 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:18:02.887367 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:18:02.887367 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:18:02.887367 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:18:02.887367 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:18:02.887367 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:18:02.887367 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:18:02.888824 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:18:02.888824 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:18:02.888824 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:18:02.888824 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:18:02.888824 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:18:02.888824 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:18:02.888824 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:18:02.888824 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e1f09bd-1e01-460e-be13-9b1749b27926 could not be found. May 26 15:18:02.888824 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:18:02.888824 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:18:02.888824 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:18:02.888824 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:18:02.888824 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:18:02.888824 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:18:02.888824 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:18:02.888824 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:18:02.888824 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e1f09bd-1e01-460e-be13-9b1749b27926 could not be found. May 26 15:18:02.888824 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:18:02.890229 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b003941d-c030-445f-bebb-bc6a07f0af0c tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Returning 404 to user: Instance 4e1f09bd-1e01-460e-be13-9b1749b27926 could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:18:02.890229 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b003941d-c030-445f-bebb-bc6a07f0af0c tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926" status: 404 len: 111 microversion: 2.1 time: 0.030337 May 26 15:18:02.890229 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 365/765] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:18:02 2022] GET /compute/v2.1/servers/4e1f09bd-1e01-460e-be13-9b1749b27926 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:18:03.052052 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-32c031af-032e-4773-96d0-9af7ac212c1f tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] Calling method '.version_select at 0x7ffb6314c040>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:03.073612 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-32c031af-032e-4773-96d0-9af7ac212c1f tempest-TestShelveInstance-1347246375 tempest-TestShelveInstance-1347246375-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-519972658" status: 202 len: 0 microversion: 2.1 time: 0.026098 May 26 15:18:03.074355 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 401/766] 10.222.0.45 () {58 vars in 1250 bytes} [Thu May 26 15:18:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-519972658 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:18:03.749735 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-aba70446-6e46-4018-8d33-d73c197d93da tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b8590f34-352d-4a9c-8fa4-0dd27fb616f8"}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:18:03.750792 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-aba70446-6e46-4018-8d33-d73c197d93da tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 819b82d5-9c2d-4302-a0ad-ba9f20cac568] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:03.756971 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-aba70446-6e46-4018-8d33-d73c197d93da tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:03.757420 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-aba70446-6e46-4018-8d33-d73c197d93da tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:03.758183 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-aba70446-6e46-4018-8d33-d73c197d93da tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:03.758616 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-aba70446-6e46-4018-8d33-d73c197d93da tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:03.856152 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-aba70446-6e46-4018-8d33-d73c197d93da tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] HTTP exception thrown: Invalid volume: volume b8590f34-352d-4a9c-8fa4-0dd27fb616f8 is already attached to instances: 819b82d5-9c2d-4302-a0ad-ba9f20cac568 May 26 15:18:03.857785 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-aba70446-6e46-4018-8d33-d73c197d93da tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Request method failure captured: May 26 15:18:03.857785 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: request: POST /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568/os-volume_attachments HTTP/1.1 May 26 15:18:03.857785 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept: application/json May 26 15:18:03.857785 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity May 26 15:18:03.857785 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Connection: close May 26 15:18:03.857785 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Length: 74 May 26 15:18:03.857785 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Type: application/json May 26 15:18:03.857785 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Host: 10.222.0.45 May 26 15:18:03.857785 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None May 26 15:18:03.857785 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 May 26 15:18:03.857785 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABij5gKsz5qj5DNdZrMFjr-Jr5xg2mNFFRPkTRxdAGsu10bP3EnBAcmrx6BKDNDgfsXd480T_XTCyywquChHsMxkBXmsyJsxmtyqnYAiCUvnNXzq6C4KvbHPcEIVG_Dh3vBN1K_0JPHyQtkc2u3wwrrdDbhsPbSJJLP4Pdm3CUM8QN6AT4 May 26 15:18:03.857785 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Id: None May 26 15:18:03.857785 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Name: None May 26 15:18:03.857785 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed May 26 15:18:03.857785 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True May 26 15:18:03.857785 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default May 26 15:18:03.857785 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default May 26 15:18:03.857785 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Id: 196700c560cd4d6e9461ec9571facf39 May 26 15:18:03.857785 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-AttachVolumeNegativeTest-1949965076 May 26 15:18:03.857785 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Role: reader,member May 26 15:18:03.857785 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Roles: reader,member May 26 15:18:03.859150 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/196700c560cd4d6e9461ec9571facf39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/196700c560cd4d6e9461ec9571facf39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/196700c560cd4d6e9461ec9571facf39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_196700c560cd4d6e9461ec9571facf39"}]}] May 26 15:18:03.859150 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-AttachVolumeNegativeTest-1949965076 May 26 15:18:03.859150 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Id: 196700c560cd4d6e9461ec9571facf39 May 26 15:18:03.859150 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1949965076 May 26 15:18:03.859150 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User: tempest-AttachVolumeNegativeTest-1949965076-project May 26 15:18:03.859150 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default May 26 15:18:03.859150 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default May 26 15:18:03.859150 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Id: 1421fb674ae04d6ea9ae342b73ce8115 May 26 15:18:03.859150 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-AttachVolumeNegativeTest-1949965076-project May 26 15:18:03.859150 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: May 26 15:18:03.859150 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: {"volumeAttachment": {"volumeId": "b8590f34-352d-4a9c-8fa4-0dd27fb616f8"}} May 26 15:18:03.859150 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: method: > May 26 15:18:03.859912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: exception: Invalid volume: volume b8590f34-352d-4a9c-8fa4-0dd27fb616f8 is already attached to instances: 819b82d5-9c2d-4302-a0ad-ba9f20cac568 May 26 15:18:03.859912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: action_args: {'server_id': '819b82d5-9c2d-4302-a0ad-ba9f20cac568', 'body': {'volumeAttachment': {'volumeId': 'b8590f34-352d-4a9c-8fa4-0dd27fb616f8'}}} May 26 15:18:03.859912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:18:03.859912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:18:03.859912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 15:18:03.859912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 15:18:03.859912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 15:18:03.859912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 15:18:03.859912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 15:18:03.859912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 15:18:03.859912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 26 15:18:03.859912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 26 15:18:03.859912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 26 15:18:03.859912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 26 15:18:03.859912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b8590f34-352d-4a9c-8fa4-0dd27fb616f8 is already attached to instances: 819b82d5-9c2d-4302-a0ad-ba9f20cac568 May 26 15:18:03.859912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:18:03.859912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:18:03.859912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:18:03.859912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:18:03.861526 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:18:03.861526 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:18:03.861526 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:18:03.861526 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:18:03.861526 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:18:03.861526 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:18:03.861526 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 15:18:03.861526 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 15:18:03.861526 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 15:18:03.861526 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 15:18:03.861526 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 15:18:03.861526 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 15:18:03.861526 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 26 15:18:03.861526 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 15:18:03.861526 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b8590f34-352d-4a9c-8fa4-0dd27fb616f8 is already attached to instances: 819b82d5-9c2d-4302-a0ad-ba9f20cac568 May 26 15:18:03.861526 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:18:03.861526 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:18:03.861526 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:18:03.861526 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:18:03.861526 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:18:03.862899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:18:03.862899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:18:03.862899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:18:03.862899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b8590f34-352d-4a9c-8fa4-0dd27fb616f8 is already attached to instances: 819b82d5-9c2d-4302-a0ad-ba9f20cac568 May 26 15:18:03.862899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:18:03.862899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-aba70446-6e46-4018-8d33-d73c197d93da tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Returning 400 to user: Invalid volume: volume b8590f34-352d-4a9c-8fa4-0dd27fb616f8 is already attached to instances: 819b82d5-9c2d-4302-a0ad-ba9f20cac568 {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:18:03.862899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-aba70446-6e46-4018-8d33-d73c197d93da tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "POST /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.113771 May 26 15:18:03.862899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 366/767] 10.222.0.45 () {60 vars in 1322 bytes} [Thu May 26 15:18:03 2022] POST /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568/os-volume_attachments => generated 174 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 15:18:03.923219 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-6f752a46-7008-484b-8f34-49b42d116fee tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:03.923725 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-6f752a46-7008-484b-8f34-49b42d116fee tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 819b82d5-9c2d-4302-a0ad-ba9f20cac568] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:03.929689 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6f752a46-7008-484b-8f34-49b42d116fee tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:03.930142 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6f752a46-7008-484b-8f34-49b42d116fee tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:03.930907 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6f752a46-7008-484b-8f34-49b42d116fee tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:03.931373 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6f752a46-7008-484b-8f34-49b42d116fee tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:04.019370 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.objects.instance [None req-6f752a46-7008-484b-8f34-49b42d116fee tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lazy-loading 'services' on Instance uuid 819b82d5-9c2d-4302-a0ad-ba9f20cac568 {{(pid=117799) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:18:04.094577 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-6f752a46-7008-484b-8f34-49b42d116fee tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "DELETE /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568/os-volume_attachments/b8590f34-352d-4a9c-8fa4-0dd27fb616f8" status: 202 len: 0 microversion: 2.1 time: 0.175242 May 26 15:18:04.098967 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 402/768] 10.222.0.45 () {58 vars in 1415 bytes} [Thu May 26 15:18:03 2022] DELETE /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568/os-volume_attachments/b8590f34-352d-4a9c-8fa4-0dd27fb616f8 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:18:04.104744 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b6cbe28d-575b-4841-ab90-6db309abc2df tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:04.105797 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b6cbe28d-575b-4841-ab90-6db309abc2df tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 819b82d5-9c2d-4302-a0ad-ba9f20cac568] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:04.114850 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b6cbe28d-575b-4841-ab90-6db309abc2df tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:04.115583 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b6cbe28d-575b-4841-ab90-6db309abc2df tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:04.116997 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b6cbe28d-575b-4841-ab90-6db309abc2df tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:04.117505 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b6cbe28d-575b-4841-ab90-6db309abc2df tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:04.161861 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b6cbe28d-575b-4841-ab90-6db309abc2df tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061415 May 26 15:18:04.162649 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 367/769] 10.222.0.45 () {58 vars in 1301 bytes} [Thu May 26 15:18:04 2022] GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:18:05.174969 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-5284ac05-1039-4eaa-998f-220880f00cbd tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:05.177151 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-5284ac05-1039-4eaa-998f-220880f00cbd tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 819b82d5-9c2d-4302-a0ad-ba9f20cac568] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:05.183868 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5284ac05-1039-4eaa-998f-220880f00cbd tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:05.184329 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5284ac05-1039-4eaa-998f-220880f00cbd tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:05.185600 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5284ac05-1039-4eaa-998f-220880f00cbd tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:05.186096 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5284ac05-1039-4eaa-998f-220880f00cbd tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:05.218771 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-5284ac05-1039-4eaa-998f-220880f00cbd tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048539 May 26 15:18:05.220026 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 403/770] 10.222.0.45 () {58 vars in 1301 bytes} [Thu May 26 15:18:05 2022] GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 15:18:05.289511 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-adb98a51-c234-42f5-b08c-e627a85580a7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:05.292146 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-adb98a51-c234-42f5-b08c-e627a85580a7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 819b82d5-9c2d-4302-a0ad-ba9f20cac568] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:05.299853 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-adb98a51-c234-42f5-b08c-e627a85580a7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:05.300335 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-adb98a51-c234-42f5-b08c-e627a85580a7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:05.301354 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-adb98a51-c234-42f5-b08c-e627a85580a7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:05.301958 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-adb98a51-c234-42f5-b08c-e627a85580a7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:05.333673 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-adb98a51-c234-42f5-b08c-e627a85580a7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 819b82d5-9c2d-4302-a0ad-ba9f20cac568] Going to try to terminate instance {{(pid=117798) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:18:05.426609 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-adb98a51-c234-42f5-b08c-e627a85580a7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "DELETE /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568" status: 204 len: 0 microversion: 2.1 time: 0.140535 May 26 15:18:05.428981 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 368/771] 10.222.0.45 () {58 vars in 1238 bytes} [Thu May 26 15:18:05 2022] DELETE /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:18:05.437363 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-f8ec9349-74d0-4588-af5f-ae5de80e35a6 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:05.438108 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-f8ec9349-74d0-4588-af5f-ae5de80e35a6 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 819b82d5-9c2d-4302-a0ad-ba9f20cac568] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:05.447217 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f8ec9349-74d0-4588-af5f-ae5de80e35a6 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:05.448251 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f8ec9349-74d0-4588-af5f-ae5de80e35a6 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:05.450297 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f8ec9349-74d0-4588-af5f-ae5de80e35a6 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:05.450927 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f8ec9349-74d0-4588-af5f-ae5de80e35a6 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:05.609040 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-f8ec9349-74d0-4588-af5f-ae5de80e35a6 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:05.617725 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-f8ec9349-74d0-4588-af5f-ae5de80e35a6 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568" status: 200 len: 1680 microversion: 2.1 time: 0.184311 May 26 15:18:05.618303 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 404/772] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:18:05 2022] GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568 => generated 1680 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:06.635404 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-324bf310-c148-4e05-9d3c-bda2b6d21842 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:06.636100 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-324bf310-c148-4e05-9d3c-bda2b6d21842 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 819b82d5-9c2d-4302-a0ad-ba9f20cac568] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:06.642815 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-324bf310-c148-4e05-9d3c-bda2b6d21842 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:06.644159 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-324bf310-c148-4e05-9d3c-bda2b6d21842 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:06.645559 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-324bf310-c148-4e05-9d3c-bda2b6d21842 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:06.646078 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-324bf310-c148-4e05-9d3c-bda2b6d21842 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:06.977429 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-324bf310-c148-4e05-9d3c-bda2b6d21842 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:06.985952 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-324bf310-c148-4e05-9d3c-bda2b6d21842 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568" status: 200 len: 1680 microversion: 2.1 time: 0.354751 May 26 15:18:06.986797 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 369/773] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:18:06 2022] GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568 => generated 1680 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:08.003664 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-588f6844-351c-4e7f-b2e1-6c41049a120b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:08.004359 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-588f6844-351c-4e7f-b2e1-6c41049a120b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 819b82d5-9c2d-4302-a0ad-ba9f20cac568] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:08.011239 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-588f6844-351c-4e7f-b2e1-6c41049a120b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:08.011693 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-588f6844-351c-4e7f-b2e1-6c41049a120b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:08.012472 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-588f6844-351c-4e7f-b2e1-6c41049a120b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:08.012921 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-588f6844-351c-4e7f-b2e1-6c41049a120b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:08.326268 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-588f6844-351c-4e7f-b2e1-6c41049a120b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:08.334007 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-588f6844-351c-4e7f-b2e1-6c41049a120b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568" status: 200 len: 1680 microversion: 2.1 time: 0.334928 May 26 15:18:08.334780 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 405/774] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:18:07 2022] GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568 => generated 1680 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:09.354651 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-56e9b892-c6fc-4c01-9072-2348da06a76f tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:09.354651 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-56e9b892-c6fc-4c01-9072-2348da06a76f tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 819b82d5-9c2d-4302-a0ad-ba9f20cac568] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:09.359169 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-56e9b892-c6fc-4c01-9072-2348da06a76f tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:09.360415 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-56e9b892-c6fc-4c01-9072-2348da06a76f tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:09.361237 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-56e9b892-c6fc-4c01-9072-2348da06a76f tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:09.361806 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-56e9b892-c6fc-4c01-9072-2348da06a76f tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:09.491123 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-86edf341-6827-4996-97d2-c2a95d349bcd req-f60da904-b79c-48a8-a03f-9e0c7d9274af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "819b82d5-9c2d-4302-a0ad-ba9f20cac568", "name": "network-vif-deleted", "tag": "8b9cfb27-2ff7-44f9-80b9-917b08868d33"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:18:09.519434 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-56e9b892-c6fc-4c01-9072-2348da06a76f tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:09.520447 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-86edf341-6827-4996-97d2-c2a95d349bcd req-f60da904-b79c-48a8-a03f-9e0c7d9274af service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:09.521088 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-86edf341-6827-4996-97d2-c2a95d349bcd req-f60da904-b79c-48a8-a03f-9e0c7d9274af service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:09.531736 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-56e9b892-c6fc-4c01-9072-2348da06a76f tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568" status: 200 len: 1612 microversion: 2.1 time: 0.184774 May 26 15:18:09.532857 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 370/775] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:18:09 2022] GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568 => generated 1612 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:09.548537 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-86edf341-6827-4996-97d2-c2a95d349bcd req-f60da904-b79c-48a8-a03f-9e0c7d9274af service nova] Creating event network-vif-deleted:8b9cfb27-2ff7-44f9-80b9-917b08868d33 for instance 819b82d5-9c2d-4302-a0ad-ba9f20cac568 on hv-cinder-84301 May 26 15:18:09.554346 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-86edf341-6827-4996-97d2-c2a95d349bcd req-f60da904-b79c-48a8-a03f-9e0c7d9274af service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068290 May 26 15:18:09.560554 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 406/776] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:18:10.551031 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b8b5d802-7e24-4e40-b156-6b1f4d8c8213 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:10.552352 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b8b5d802-7e24-4e40-b156-6b1f4d8c8213 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 819b82d5-9c2d-4302-a0ad-ba9f20cac568] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:10.566481 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b8b5d802-7e24-4e40-b156-6b1f4d8c8213 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:10.566932 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b8b5d802-7e24-4e40-b156-6b1f4d8c8213 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:10.567734 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b8b5d802-7e24-4e40-b156-6b1f4d8c8213 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:10.568163 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b8b5d802-7e24-4e40-b156-6b1f4d8c8213 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:10.585896 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-b8b5d802-7e24-4e40-b156-6b1f4d8c8213 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] HTTP exception thrown: Instance 819b82d5-9c2d-4302-a0ad-ba9f20cac568 could not be found. May 26 15:18:10.588091 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b8b5d802-7e24-4e40-b156-6b1f4d8c8213 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Request method failure captured: May 26 15:18:10.588091 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: request: GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568 HTTP/1.1 May 26 15:18:10.588091 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept: application/json May 26 15:18:10.588091 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity May 26 15:18:10.588091 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Connection: close May 26 15:18:10.588091 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Length: 0 May 26 15:18:10.588091 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Type: application/json May 26 15:18:10.588091 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Host: 10.222.0.45 May 26 15:18:10.588091 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None May 26 15:18:10.588091 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 May 26 15:18:10.588091 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABij5gKsz5qj5DNdZrMFjr-Jr5xg2mNFFRPkTRxdAGsu10bP3EnBAcmrx6BKDNDgfsXd480T_XTCyywquChHsMxkBXmsyJsxmtyqnYAiCUvnNXzq6C4KvbHPcEIVG_Dh3vBN1K_0JPHyQtkc2u3wwrrdDbhsPbSJJLP4Pdm3CUM8QN6AT4 May 26 15:18:10.588091 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Id: None May 26 15:18:10.588091 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Name: None May 26 15:18:10.588091 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed May 26 15:18:10.588091 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True May 26 15:18:10.588091 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default May 26 15:18:10.588091 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default May 26 15:18:10.588091 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Id: 196700c560cd4d6e9461ec9571facf39 May 26 15:18:10.588091 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-AttachVolumeNegativeTest-1949965076 May 26 15:18:10.588091 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Role: reader,member May 26 15:18:10.588091 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Roles: reader,member May 26 15:18:10.590015 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/196700c560cd4d6e9461ec9571facf39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/196700c560cd4d6e9461ec9571facf39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/196700c560cd4d6e9461ec9571facf39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_196700c560cd4d6e9461ec9571facf39"}]}] May 26 15:18:10.590015 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-AttachVolumeNegativeTest-1949965076 May 26 15:18:10.590015 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Id: 196700c560cd4d6e9461ec9571facf39 May 26 15:18:10.590015 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1949965076 May 26 15:18:10.590015 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User: tempest-AttachVolumeNegativeTest-1949965076-project May 26 15:18:10.590015 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default May 26 15:18:10.590015 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default May 26 15:18:10.590015 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Id: 1421fb674ae04d6ea9ae342b73ce8115 May 26 15:18:10.590015 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-AttachVolumeNegativeTest-1949965076-project May 26 15:18:10.590015 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: method: > May 26 15:18:10.590015 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: exception: Instance 819b82d5-9c2d-4302-a0ad-ba9f20cac568 could not be found. May 26 15:18:10.590015 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: action_args: {'id': '819b82d5-9c2d-4302-a0ad-ba9f20cac568'} May 26 15:18:10.590891 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:18:10.590891 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:18:10.590891 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:18:10.590891 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:18:10.590891 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:18:10.590891 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:18:10.590891 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:18:10.590891 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:18:10.590891 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:18:10.590891 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:18:10.590891 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 819b82d5-9c2d-4302-a0ad-ba9f20cac568 could not be found. May 26 15:18:10.590891 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:18:10.590891 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:18:10.590891 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:18:10.590891 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:18:10.590891 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:18:10.590891 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:18:10.590891 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:18:10.590891 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:18:10.590891 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:18:10.596691 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:18:10.596691 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:18:10.596691 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:18:10.596691 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:18:10.596691 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:18:10.596691 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:18:10.596691 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:18:10.596691 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 819b82d5-9c2d-4302-a0ad-ba9f20cac568 could not be found. May 26 15:18:10.596691 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:18:10.596691 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:18:10.596691 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:18:10.596691 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:18:10.596691 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:18:10.596691 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:18:10.596691 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:18:10.596691 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:18:10.596691 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 819b82d5-9c2d-4302-a0ad-ba9f20cac568 could not be found. May 26 15:18:10.596691 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:18:10.598333 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b8b5d802-7e24-4e40-b156-6b1f4d8c8213 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Returning 404 to user: Instance 819b82d5-9c2d-4302-a0ad-ba9f20cac568 could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:18:10.598333 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b8b5d802-7e24-4e40-b156-6b1f4d8c8213 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568" status: 404 len: 111 microversion: 2.1 time: 0.043760 May 26 15:18:10.598333 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 371/777] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:18:10 2022] GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:18:10.601851 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-3e7ab12f-fedd-4abd-bb3c-2778168ab362 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '.version_select at 0x7ffb63030820>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:10.622852 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-3e7ab12f-fedd-4abd-bb3c-2778168ab362 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-510980125" status: 202 len: 0 microversion: 2.1 time: 0.026863 May 26 15:18:10.627886 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 407/778] 10.222.0.45 () {58 vars in 1217 bytes} [Thu May 26 15:18:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-510980125 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:18:11.446644 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-16953c1c-3fd0-4af4-afdb-b786b8206f20 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Action: 'create', calling method: .version_select at 0x7ffb5e811f70>, body: {"keypair": {"name": "tempest-keypair-171383666", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGuuNLXibo/+piHyIXJtW0ES7AM3MZMboJRCdTQRQ18NqvDexq2Qu3LdFbqyiiLjgAKaaOsQfH3U6B1cgYvdG+rF4jDj49cUGcWqJZkQbB9Rdjdf4Hzci/KzqIVajNtc+Q=="}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:18:11.460505 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-16953c1c-3fd0-4af4-afdb-b786b8206f20 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Getting quotas for project 196700c560cd4d6e9461ec9571facf39. Resources: {'key_pairs'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:18:11.465127 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-16953c1c-3fd0-4af4-afdb-b786b8206f20 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Getting quotas for user 1421fb674ae04d6ea9ae342b73ce8115 and project 196700c560cd4d6e9461ec9571facf39. Resources: {'key_pairs'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:18:11.489383 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-16953c1c-3fd0-4af4-afdb-b786b8206f20 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046778 May 26 15:18:11.489991 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 372/779] 10.222.0.45 () {60 vars in 1158 bytes} [Thu May 26 15:18:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:18:12.851189 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-74fd8a07-46bc-4027-b9bd-9687b9b0595e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1676786374", "imageRef": "5b5a68b4-38e3-4f05-b97f-4339d6752e34", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aeb58b02-96d6-4f2b-8272-441acfd1f591"}], "security_groups": [{"name": "tempest-securitygroup--344093658"}], "key_name": "tempest-keypair-171383666", "user_data": "}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:18:12.951900 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.network.neutron [None req-74fd8a07-46bc-4027-b9bd-9687b9b0595e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] validate_networks() for [('aeb58b02-96d6-4f2b-8272-441acfd1f591', None, None, None, None, None)] {{(pid=117799) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:18:13.320896 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-74fd8a07-46bc-4027-b9bd-9687b9b0595e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Flavor limits 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:18:13.321320 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-74fd8a07-46bc-4027-b9bd-9687b9b0595e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Image limits 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:18:13.321794 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-74fd8a07-46bc-4027-b9bd-9687b9b0595e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Flavor pref 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:18:13.322205 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-74fd8a07-46bc-4027-b9bd-9687b9b0595e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Image pref 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:18:13.322619 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-74fd8a07-46bc-4027-b9bd-9687b9b0595e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:18:13.331568 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-74fd8a07-46bc-4027-b9bd-9687b9b0595e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:13.332016 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-74fd8a07-46bc-4027-b9bd-9687b9b0595e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:13.332817 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-74fd8a07-46bc-4027-b9bd-9687b9b0595e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:13.333256 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-74fd8a07-46bc-4027-b9bd-9687b9b0595e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:13.349769 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.quota [None req-74fd8a07-46bc-4027-b9bd-9687b9b0595e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Getting quotas for project 196700c560cd4d6e9461ec9571facf39. Resources: {'cores', 'ram', 'instances'} {{(pid=117799) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:18:13.353687 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.quota [None req-74fd8a07-46bc-4027-b9bd-9687b9b0595e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Getting quotas for user 1421fb674ae04d6ea9ae342b73ce8115 and project 196700c560cd4d6e9461ec9571facf39. Resources: {'cores', 'ram', 'instances'} {{(pid=117799) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:18:13.365268 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-74fd8a07-46bc-4027-b9bd-9687b9b0595e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Going to run 1 instances... {{(pid=117799) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:18:13.367630 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-74fd8a07-46bc-4027-b9bd-9687b9b0595e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: bf3c9c21-27ca-402b-9e1a-66a72cefb32f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5b5a68b4-38e3-4f05-b97f-4339d6752e34',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117799) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:18:13.415525 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-74fd8a07-46bc-4027-b9bd-9687b9b0595e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.569706 May 26 15:18:13.416186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 408/780] 10.222.0.45 () {60 vars in 1146 bytes} [Thu May 26 15:18:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 15:18:13.428501 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e3cc565e-2bda-4f09-8ac6-1935b7c288fe tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:13.429112 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e3cc565e-2bda-4f09-8ac6-1935b7c288fe tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: bf3c9c21-27ca-402b-9e1a-66a72cefb32f] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:13.485229 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e3cc565e-2bda-4f09-8ac6-1935b7c288fe tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:13.492519 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e3cc565e-2bda-4f09-8ac6-1935b7c288fe tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f" status: 200 len: 1241 microversion: 2.1 time: 0.070219 May 26 15:18:13.493320 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 373/781] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:18:13 2022] GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:14.509747 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-22c26708-8721-4867-9083-f3cf16f38546 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:14.510434 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-22c26708-8721-4867-9083-f3cf16f38546 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: bf3c9c21-27ca-402b-9e1a-66a72cefb32f] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:14.518596 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-22c26708-8721-4867-9083-f3cf16f38546 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:14.519351 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-22c26708-8721-4867-9083-f3cf16f38546 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:14.520201 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-22c26708-8721-4867-9083-f3cf16f38546 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:14.520700 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-22c26708-8721-4867-9083-f3cf16f38546 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:14.589563 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-22c26708-8721-4867-9083-f3cf16f38546 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:14.598070 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-22c26708-8721-4867-9083-f3cf16f38546 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f" status: 200 len: 1299 microversion: 2.1 time: 0.092451 May 26 15:18:14.598635 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 409/782] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:18:14 2022] GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f => generated 1299 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:15.616210 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-295731b7-4092-4e6c-9720-7cdb47afaca7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:15.616946 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-295731b7-4092-4e6c-9720-7cdb47afaca7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: bf3c9c21-27ca-402b-9e1a-66a72cefb32f] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:15.629124 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-295731b7-4092-4e6c-9720-7cdb47afaca7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:15.629124 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-295731b7-4092-4e6c-9720-7cdb47afaca7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:15.630296 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-295731b7-4092-4e6c-9720-7cdb47afaca7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:15.630893 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-295731b7-4092-4e6c-9720-7cdb47afaca7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:15.829588 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-295731b7-4092-4e6c-9720-7cdb47afaca7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:15.837707 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-295731b7-4092-4e6c-9720-7cdb47afaca7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f" status: 200 len: 1366 microversion: 2.1 time: 0.226380 May 26 15:18:15.838584 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 374/783] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:18:15 2022] GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:15.918366 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-87d39d24-f368-4ee5-ac07-2a83325ffbfe req-9b5a2e7d-1a0d-426e-9018-8e6f400d8add service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf3c9c21-27ca-402b-9e1a-66a72cefb32f", "tag": "d6fa16db-1301-4e83-aecd-89e7a66460a3"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:18:15.930292 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-87d39d24-f368-4ee5-ac07-2a83325ffbfe req-9b5a2e7d-1a0d-426e-9018-8e6f400d8add service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:15.930810 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-87d39d24-f368-4ee5-ac07-2a83325ffbfe req-9b5a2e7d-1a0d-426e-9018-8e6f400d8add service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:15.943544 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-87d39d24-f368-4ee5-ac07-2a83325ffbfe req-9b5a2e7d-1a0d-426e-9018-8e6f400d8add service nova] Creating event network-changed:d6fa16db-1301-4e83-aecd-89e7a66460a3 for instance bf3c9c21-27ca-402b-9e1a-66a72cefb32f on hv-cinder-84301 May 26 15:18:15.949113 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-87d39d24-f368-4ee5-ac07-2a83325ffbfe req-9b5a2e7d-1a0d-426e-9018-8e6f400d8add service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034456 May 26 15:18:15.950227 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 410/784] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:18:16.854016 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-bc589b4e-c303-40e7-852b-0227b472acdd tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:16.854630 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-bc589b4e-c303-40e7-852b-0227b472acdd tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: bf3c9c21-27ca-402b-9e1a-66a72cefb32f] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:16.861179 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bc589b4e-c303-40e7-852b-0227b472acdd tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:16.861644 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bc589b4e-c303-40e7-852b-0227b472acdd tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:16.862381 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bc589b4e-c303-40e7-852b-0227b472acdd tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:16.862812 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bc589b4e-c303-40e7-852b-0227b472acdd tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:16.999315 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-bc589b4e-c303-40e7-852b-0227b472acdd tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:17.007690 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-bc589b4e-c303-40e7-852b-0227b472acdd tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f" status: 200 len: 1366 microversion: 2.1 time: 0.157500 May 26 15:18:17.008276 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 375/785] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:18:16 2022] GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:18.028120 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-7efbaf5f-8cb8-4068-a326-06f58e969b8e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:18.028842 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-7efbaf5f-8cb8-4068-a326-06f58e969b8e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: bf3c9c21-27ca-402b-9e1a-66a72cefb32f] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:18.036154 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7efbaf5f-8cb8-4068-a326-06f58e969b8e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:18.036605 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7efbaf5f-8cb8-4068-a326-06f58e969b8e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:18.037379 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7efbaf5f-8cb8-4068-a326-06f58e969b8e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:18.037821 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7efbaf5f-8cb8-4068-a326-06f58e969b8e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:18.165122 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-7efbaf5f-8cb8-4068-a326-06f58e969b8e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:18.172449 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-7efbaf5f-8cb8-4068-a326-06f58e969b8e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f" status: 200 len: 1366 microversion: 2.1 time: 0.149337 May 26 15:18:18.173012 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 411/786] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:18:18 2022] GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:19.189238 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c921d1c3-0c39-4586-9fe9-e0ae46b89641 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:19.190993 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c921d1c3-0c39-4586-9fe9-e0ae46b89641 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: bf3c9c21-27ca-402b-9e1a-66a72cefb32f] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:19.197715 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c921d1c3-0c39-4586-9fe9-e0ae46b89641 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:19.198156 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c921d1c3-0c39-4586-9fe9-e0ae46b89641 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:19.198917 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c921d1c3-0c39-4586-9fe9-e0ae46b89641 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:19.199366 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c921d1c3-0c39-4586-9fe9-e0ae46b89641 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:19.428301 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c921d1c3-0c39-4586-9fe9-e0ae46b89641 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:19.436410 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c921d1c3-0c39-4586-9fe9-e0ae46b89641 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f" status: 200 len: 1366 microversion: 2.1 time: 0.251205 May 26 15:18:19.436984 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 376/787] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:18:19 2022] GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:20.453558 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-cb0c9fb3-6713-4883-b6a2-4ef13e86aefe tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:20.454285 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-cb0c9fb3-6713-4883-b6a2-4ef13e86aefe tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: bf3c9c21-27ca-402b-9e1a-66a72cefb32f] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:20.464823 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-cb0c9fb3-6713-4883-b6a2-4ef13e86aefe tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:20.465542 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-cb0c9fb3-6713-4883-b6a2-4ef13e86aefe tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:20.466863 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-cb0c9fb3-6713-4883-b6a2-4ef13e86aefe tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:20.467533 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-cb0c9fb3-6713-4883-b6a2-4ef13e86aefe tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:20.608828 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-cb0c9fb3-6713-4883-b6a2-4ef13e86aefe tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:20.618378 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-cb0c9fb3-6713-4883-b6a2-4ef13e86aefe tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f" status: 200 len: 1366 microversion: 2.1 time: 0.168682 May 26 15:18:20.618959 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 412/788] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:18:20 2022] GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:21.636582 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-cd5ea609-fffc-48e4-944d-6100cddd9147 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:21.637192 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-cd5ea609-fffc-48e4-944d-6100cddd9147 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: bf3c9c21-27ca-402b-9e1a-66a72cefb32f] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:21.644133 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cd5ea609-fffc-48e4-944d-6100cddd9147 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:21.644581 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cd5ea609-fffc-48e4-944d-6100cddd9147 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:21.645367 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cd5ea609-fffc-48e4-944d-6100cddd9147 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:21.645789 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cd5ea609-fffc-48e4-944d-6100cddd9147 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:21.771918 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-cd5ea609-fffc-48e4-944d-6100cddd9147 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:21.779323 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-cd5ea609-fffc-48e4-944d-6100cddd9147 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f" status: 200 len: 1366 microversion: 2.1 time: 0.147500 May 26 15:18:21.779882 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 377/789] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:18:21 2022] GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:22.309432 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-33ac4d31-1c7a-41b2-9367-d47b8b7b0f78 req-073ccd14-f15f-4018-aa4c-22ae93e68de3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf3c9c21-27ca-402b-9e1a-66a72cefb32f", "name": "network-vif-plugged", "status": "completed", "tag": "d6fa16db-1301-4e83-aecd-89e7a66460a3"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:18:22.318524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-33ac4d31-1c7a-41b2-9367-d47b8b7b0f78 req-073ccd14-f15f-4018-aa4c-22ae93e68de3 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:22.319045 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-33ac4d31-1c7a-41b2-9367-d47b8b7b0f78 req-073ccd14-f15f-4018-aa4c-22ae93e68de3 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:22.331923 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-33ac4d31-1c7a-41b2-9367-d47b8b7b0f78 req-073ccd14-f15f-4018-aa4c-22ae93e68de3 service nova] Creating event network-vif-plugged:d6fa16db-1301-4e83-aecd-89e7a66460a3 for instance bf3c9c21-27ca-402b-9e1a-66a72cefb32f on hv-cinder-84301 May 26 15:18:22.336980 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-33ac4d31-1c7a-41b2-9367-d47b8b7b0f78 req-073ccd14-f15f-4018-aa4c-22ae93e68de3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031281 May 26 15:18:22.337772 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 413/790] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:18:22.796374 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-11c41bff-c0e9-4660-95a4-8a296780be80 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:22.796893 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-11c41bff-c0e9-4660-95a4-8a296780be80 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: bf3c9c21-27ca-402b-9e1a-66a72cefb32f] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:22.803376 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-11c41bff-c0e9-4660-95a4-8a296780be80 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:22.803821 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-11c41bff-c0e9-4660-95a4-8a296780be80 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:22.804581 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-11c41bff-c0e9-4660-95a4-8a296780be80 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:22.805013 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-11c41bff-c0e9-4660-95a4-8a296780be80 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:22.936079 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-11c41bff-c0e9-4660-95a4-8a296780be80 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:22.943931 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-11c41bff-c0e9-4660-95a4-8a296780be80 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f" status: 200 len: 1366 microversion: 2.1 time: 0.151517 May 26 15:18:22.944497 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 378/791] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:18:22 2022] GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:23.138409 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-f2e552a6-697f-4f28-9173-cd3c7d26a7dd tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:23.138978 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-f2e552a6-697f-4f28-9173-cd3c7d26a7dd tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:23.146000 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f2e552a6-697f-4f28-9173-cd3c7d26a7dd tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:23.146443 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f2e552a6-697f-4f28-9173-cd3c7d26a7dd tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:23.147288 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f2e552a6-697f-4f28-9173-cd3c7d26a7dd tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:23.147718 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f2e552a6-697f-4f28-9173-cd3c7d26a7dd tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:23.170163 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-f2e552a6-697f-4f28-9173-cd3c7d26a7dd tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b/ips" status: 200 len: 153 microversion: 2.20 time: 0.035931 May 26 15:18:23.170723 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 414/792] 10.222.0.45 () {60 vars in 1288 bytes} [Thu May 26 15:18:23 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b/ips => generated 153 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:18:23.960677 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-cde68792-5892-4ebe-9602-89a5ce1d7b90 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:23.961289 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-cde68792-5892-4ebe-9602-89a5ce1d7b90 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: bf3c9c21-27ca-402b-9e1a-66a72cefb32f] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:23.963277 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=6 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:18:23.969181 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cde68792-5892-4ebe-9602-89a5ce1d7b90 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:23.969630 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cde68792-5892-4ebe-9602-89a5ce1d7b90 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:23.970391 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cde68792-5892-4ebe-9602-89a5ce1d7b90 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:23.970825 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cde68792-5892-4ebe-9602-89a5ce1d7b90 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:24.099845 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-cde68792-5892-4ebe-9602-89a5ce1d7b90 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:24.107365 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-cde68792-5892-4ebe-9602-89a5ce1d7b90 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f" status: 200 len: 1366 microversion: 2.1 time: 0.150507 May 26 15:18:24.107934 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 379/793] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:18:23 2022] GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:18:25.099448 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-7a856124-96fb-433f-b7af-09a20f9f73c6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:18:25.100015 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-7a856124-96fb-433f-b7af-09a20f9f73c6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:25.102314 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell0:SELECT=2 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:18:25.103055 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell0:SELECT=6 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:18:25.108682 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7a856124-96fb-433f-b7af-09a20f9f73c6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:25.109180 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7a856124-96fb-433f-b7af-09a20f9f73c6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:25.110000 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7a856124-96fb-433f-b7af-09a20f9f73c6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:25.110717 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7a856124-96fb-433f-b7af-09a20f9f73c6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:25.124150 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-9d5d985b-073a-4184-bcc0-4f6ae23e2bbf tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:25.125067 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-9d5d985b-073a-4184-bcc0-4f6ae23e2bbf tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: bf3c9c21-27ca-402b-9e1a-66a72cefb32f] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:25.131648 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9d5d985b-073a-4184-bcc0-4f6ae23e2bbf tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:25.132102 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9d5d985b-073a-4184-bcc0-4f6ae23e2bbf tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:25.132987 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9d5d985b-073a-4184-bcc0-4f6ae23e2bbf tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:25.133356 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9d5d985b-073a-4184-bcc0-4f6ae23e2bbf tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:25.134474 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.objects.instance [None req-7a856124-96fb-433f-b7af-09a20f9f73c6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lazy-loading 'flavor' on Instance uuid d97e6323-aeef-4755-9bc5-93ae5140640b {{(pid=117799) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:18:25.273663 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-9d5d985b-073a-4184-bcc0-4f6ae23e2bbf tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:25.281303 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-9d5d985b-073a-4184-bcc0-4f6ae23e2bbf tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f" status: 200 len: 1557 microversion: 2.1 time: 0.160969 May 26 15:18:25.281857 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 380/794] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:18:25 2022] GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f => generated 1557 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:18:25.298661 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c64462bb-d8e1-47ab-bd72-aa46b50bbafa tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:25.299072 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c64462bb-d8e1-47ab-bd72-aa46b50bbafa tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: bf3c9c21-27ca-402b-9e1a-66a72cefb32f] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:25.305326 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c64462bb-d8e1-47ab-bd72-aa46b50bbafa tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:25.305768 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c64462bb-d8e1-47ab-bd72-aa46b50bbafa tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:25.306517 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c64462bb-d8e1-47ab-bd72-aa46b50bbafa tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:25.306943 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c64462bb-d8e1-47ab-bd72-aa46b50bbafa tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:25.389155 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c64462bb-d8e1-47ab-bd72-aa46b50bbafa tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094391 May 26 15:18:25.389757 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 381/795] 10.222.0.45 () {58 vars in 1274 bytes} [Thu May 26 15:18:25 2022] GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:18:25.397564 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-7a856124-96fb-433f-b7af-09a20f9f73c6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "POST /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b/action" status: 202 len: 0 microversion: 2.20 time: 0.302567 May 26 15:18:25.398330 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 415/796] 10.222.0.45 () {62 vars in 1318 bytes} [Thu May 26 15:18:25 2022] POST /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 15:18:25.406453 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-7227376e-e7f6-4562-94a7-9ef5d8e0ae60 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:25.407393 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-7227376e-e7f6-4562-94a7-9ef5d8e0ae60 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:25.414799 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7227376e-e7f6-4562-94a7-9ef5d8e0ae60 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:25.415586 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7227376e-e7f6-4562-94a7-9ef5d8e0ae60 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:25.416371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7227376e-e7f6-4562-94a7-9ef5d8e0ae60 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:25.416809 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7227376e-e7f6-4562-94a7-9ef5d8e0ae60 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:25.432399 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:18:25.691886 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7227376e-e7f6-4562-94a7-9ef5d8e0ae60 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:25.699704 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7227376e-e7f6-4562-94a7-9ef5d8e0ae60 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:25.701251 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7227376e-e7f6-4562-94a7-9ef5d8e0ae60 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:25.702408 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-7227376e-e7f6-4562-94a7-9ef5d8e0ae60 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1725 microversion: 2.20 time: 0.299879 May 26 15:18:25.702961 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 382/797] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:18:25 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1725 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:18:26.647145 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-1f2f090e-70cb-4afe-9fe2-24815e685ad4 req-d409e2ba-efda-4c1b-8d6b-d5a4e9a18365 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf3c9c21-27ca-402b-9e1a-66a72cefb32f", "tag": "d6fa16db-1301-4e83-aecd-89e7a66460a3"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:18:26.655490 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-1f2f090e-70cb-4afe-9fe2-24815e685ad4 req-d409e2ba-efda-4c1b-8d6b-d5a4e9a18365 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:26.655929 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-1f2f090e-70cb-4afe-9fe2-24815e685ad4 req-d409e2ba-efda-4c1b-8d6b-d5a4e9a18365 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:26.667945 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-1f2f090e-70cb-4afe-9fe2-24815e685ad4 req-d409e2ba-efda-4c1b-8d6b-d5a4e9a18365 service nova] Creating event network-changed:d6fa16db-1301-4e83-aecd-89e7a66460a3 for instance bf3c9c21-27ca-402b-9e1a-66a72cefb32f on hv-cinder-84301 May 26 15:18:26.672937 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-1f2f090e-70cb-4afe-9fe2-24815e685ad4 req-d409e2ba-efda-4c1b-8d6b-d5a4e9a18365 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031286 May 26 15:18:26.673594 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 416/798] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:18:26.722878 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-0e58c7e5-3556-4961-9778-cfc475e66faf tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:26.723581 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-0e58c7e5-3556-4961-9778-cfc475e66faf tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:26.730269 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0e58c7e5-3556-4961-9778-cfc475e66faf tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:26.730827 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0e58c7e5-3556-4961-9778-cfc475e66faf tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:26.731742 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0e58c7e5-3556-4961-9778-cfc475e66faf tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:26.732262 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0e58c7e5-3556-4961-9778-cfc475e66faf tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:26.976153 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-0e58c7e5-3556-4961-9778-cfc475e66faf tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:26.988751 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-0e58c7e5-3556-4961-9778-cfc475e66faf tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:26.990404 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-0e58c7e5-3556-4961-9778-cfc475e66faf tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:26.992023 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-0e58c7e5-3556-4961-9778-cfc475e66faf tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1725 microversion: 2.20 time: 0.274219 May 26 15:18:26.993002 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 383/799] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:18:26 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1725 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:18:28.012272 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-3ca05123-9f37-4510-9dec-2c05c8eea3a8 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:28.012950 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-3ca05123-9f37-4510-9dec-2c05c8eea3a8 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:28.019484 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-3ca05123-9f37-4510-9dec-2c05c8eea3a8 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:28.019935 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-3ca05123-9f37-4510-9dec-2c05c8eea3a8 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:28.020695 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-3ca05123-9f37-4510-9dec-2c05c8eea3a8 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:28.021138 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-3ca05123-9f37-4510-9dec-2c05c8eea3a8 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:28.023796 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:18:28.159439 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-3ca05123-9f37-4510-9dec-2c05c8eea3a8 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:28.167468 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-3ca05123-9f37-4510-9dec-2c05c8eea3a8 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:28.168959 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-3ca05123-9f37-4510-9dec-2c05c8eea3a8 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:28.170109 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-3ca05123-9f37-4510-9dec-2c05c8eea3a8 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1725 microversion: 2.20 time: 0.162716 May 26 15:18:28.170659 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 417/800] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:18:28 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:18:29.189377 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e0158e2d-9775-48cf-8ce2-48b78b153879 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:29.190669 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e0158e2d-9775-48cf-8ce2-48b78b153879 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:29.197389 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e0158e2d-9775-48cf-8ce2-48b78b153879 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:29.197830 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e0158e2d-9775-48cf-8ce2-48b78b153879 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:29.198589 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e0158e2d-9775-48cf-8ce2-48b78b153879 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:29.199014 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e0158e2d-9775-48cf-8ce2-48b78b153879 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:29.483575 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e0158e2d-9775-48cf-8ce2-48b78b153879 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:29.491958 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e0158e2d-9775-48cf-8ce2-48b78b153879 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:29.493439 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e0158e2d-9775-48cf-8ce2-48b78b153879 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:29.494586 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e0158e2d-9775-48cf-8ce2-48b78b153879 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1725 microversion: 2.20 time: 0.309108 May 26 15:18:29.495141 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 384/801] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:18:29 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1725 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:18:30.512990 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-e092c35f-465f-49ac-bce4-576c2c12f528 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:30.513605 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-e092c35f-465f-49ac-bce4-576c2c12f528 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:30.515943 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:18:30.521994 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e092c35f-465f-49ac-bce4-576c2c12f528 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:30.522446 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e092c35f-465f-49ac-bce4-576c2c12f528 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:30.523254 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e092c35f-465f-49ac-bce4-576c2c12f528 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:30.523693 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e092c35f-465f-49ac-bce4-576c2c12f528 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:30.656231 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-e092c35f-465f-49ac-bce4-576c2c12f528 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:30.665024 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-e092c35f-465f-49ac-bce4-576c2c12f528 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:30.666533 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-e092c35f-465f-49ac-bce4-576c2c12f528 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:30.667794 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-e092c35f-465f-49ac-bce4-576c2c12f528 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1725 microversion: 2.20 time: 0.158753 May 26 15:18:30.668356 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 418/802] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:18:30 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:18:31.686138 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-90d14a5b-626a-41e6-88f5-c2dab8284009 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:31.686747 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-90d14a5b-626a-41e6-88f5-c2dab8284009 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:31.689139 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:18:31.694611 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-90d14a5b-626a-41e6-88f5-c2dab8284009 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:31.695051 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-90d14a5b-626a-41e6-88f5-c2dab8284009 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:31.695832 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-90d14a5b-626a-41e6-88f5-c2dab8284009 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:31.696260 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-90d14a5b-626a-41e6-88f5-c2dab8284009 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:31.825148 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-90d14a5b-626a-41e6-88f5-c2dab8284009 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:31.833552 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-90d14a5b-626a-41e6-88f5-c2dab8284009 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:31.835044 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-90d14a5b-626a-41e6-88f5-c2dab8284009 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:31.836218 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-90d14a5b-626a-41e6-88f5-c2dab8284009 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1725 microversion: 2.20 time: 0.153957 May 26 15:18:31.836758 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 385/803] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:18:31 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:18:32.856526 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-1c827cba-c6f7-4269-96be-6653c783c9e3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:32.857170 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-1c827cba-c6f7-4269-96be-6653c783c9e3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:32.864300 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1c827cba-c6f7-4269-96be-6653c783c9e3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:32.864747 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1c827cba-c6f7-4269-96be-6653c783c9e3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:32.865506 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1c827cba-c6f7-4269-96be-6653c783c9e3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:32.865943 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1c827cba-c6f7-4269-96be-6653c783c9e3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:32.993609 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-1c827cba-c6f7-4269-96be-6653c783c9e3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:33.001406 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-1c827cba-c6f7-4269-96be-6653c783c9e3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:33.003717 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-1c827cba-c6f7-4269-96be-6653c783c9e3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:33.004880 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-1c827cba-c6f7-4269-96be-6653c783c9e3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1725 microversion: 2.20 time: 0.152765 May 26 15:18:33.005445 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 419/804] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:18:32 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:18:34.024544 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e6165535-1561-4774-8ffd-2284df6680e7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:34.025148 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e6165535-1561-4774-8ffd-2284df6680e7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:34.031820 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e6165535-1561-4774-8ffd-2284df6680e7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:34.032267 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e6165535-1561-4774-8ffd-2284df6680e7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:34.033040 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e6165535-1561-4774-8ffd-2284df6680e7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:34.033478 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e6165535-1561-4774-8ffd-2284df6680e7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:34.162944 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e6165535-1561-4774-8ffd-2284df6680e7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:34.171300 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e6165535-1561-4774-8ffd-2284df6680e7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:34.172805 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e6165535-1561-4774-8ffd-2284df6680e7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:34.173958 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e6165535-1561-4774-8ffd-2284df6680e7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1725 microversion: 2.20 time: 0.153398 May 26 15:18:34.174515 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 386/805] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:18:34 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:18:35.192969 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-b3c0bbb6-d630-4cca-93b1-ec9e07cf88ad tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:35.193579 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-b3c0bbb6-d630-4cca-93b1-ec9e07cf88ad tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:35.200244 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b3c0bbb6-d630-4cca-93b1-ec9e07cf88ad tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:35.200697 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b3c0bbb6-d630-4cca-93b1-ec9e07cf88ad tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:35.201471 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b3c0bbb6-d630-4cca-93b1-ec9e07cf88ad tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:35.201908 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b3c0bbb6-d630-4cca-93b1-ec9e07cf88ad tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:35.329315 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-b3c0bbb6-d630-4cca-93b1-ec9e07cf88ad tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:35.337830 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-b3c0bbb6-d630-4cca-93b1-ec9e07cf88ad tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:35.339367 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-b3c0bbb6-d630-4cca-93b1-ec9e07cf88ad tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:35.340532 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-b3c0bbb6-d630-4cca-93b1-ec9e07cf88ad tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1725 microversion: 2.20 time: 0.152084 May 26 15:18:35.341089 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 420/806] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:18:35 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:18:36.359567 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-da05d761-2395-489e-a88c-eb8ad84a1451 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:36.360167 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-da05d761-2395-489e-a88c-eb8ad84a1451 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:36.367233 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-da05d761-2395-489e-a88c-eb8ad84a1451 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:36.367678 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-da05d761-2395-489e-a88c-eb8ad84a1451 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:36.368445 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-da05d761-2395-489e-a88c-eb8ad84a1451 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:36.368877 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-da05d761-2395-489e-a88c-eb8ad84a1451 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:36.507191 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-da05d761-2395-489e-a88c-eb8ad84a1451 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:36.515392 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-da05d761-2395-489e-a88c-eb8ad84a1451 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:36.517618 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-da05d761-2395-489e-a88c-eb8ad84a1451 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:36.519340 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-da05d761-2395-489e-a88c-eb8ad84a1451 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1725 microversion: 2.20 time: 0.163694 May 26 15:18:36.519920 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 387/807] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:18:36 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:18:37.538116 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-64cefe76-0bf0-4ba0-ac26-5252f3825131 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:37.538722 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-64cefe76-0bf0-4ba0-ac26-5252f3825131 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:37.545228 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-64cefe76-0bf0-4ba0-ac26-5252f3825131 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:37.545678 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-64cefe76-0bf0-4ba0-ac26-5252f3825131 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:37.546446 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-64cefe76-0bf0-4ba0-ac26-5252f3825131 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:37.546882 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-64cefe76-0bf0-4ba0-ac26-5252f3825131 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:37.675282 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-64cefe76-0bf0-4ba0-ac26-5252f3825131 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:37.683116 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-64cefe76-0bf0-4ba0-ac26-5252f3825131 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:37.684690 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-64cefe76-0bf0-4ba0-ac26-5252f3825131 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:37.686006 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-64cefe76-0bf0-4ba0-ac26-5252f3825131 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1725 microversion: 2.20 time: 0.152035 May 26 15:18:37.686778 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 421/808] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:18:37 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:18:38.706966 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ec134fb0-ba3d-4a7a-b1dc-ca5927f0f1b5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:38.707604 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ec134fb0-ba3d-4a7a-b1dc-ca5927f0f1b5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:38.714064 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ec134fb0-ba3d-4a7a-b1dc-ca5927f0f1b5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:38.714510 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ec134fb0-ba3d-4a7a-b1dc-ca5927f0f1b5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:38.715312 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ec134fb0-ba3d-4a7a-b1dc-ca5927f0f1b5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:38.715744 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ec134fb0-ba3d-4a7a-b1dc-ca5927f0f1b5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:38.845824 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ec134fb0-ba3d-4a7a-b1dc-ca5927f0f1b5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:38.853697 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ec134fb0-ba3d-4a7a-b1dc-ca5927f0f1b5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:38.855290 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ec134fb0-ba3d-4a7a-b1dc-ca5927f0f1b5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:38.856443 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ec134fb0-ba3d-4a7a-b1dc-ca5927f0f1b5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1725 microversion: 2.20 time: 0.154329 May 26 15:18:38.856987 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 388/809] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:18:38 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:18:39.875450 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-84b6c867-fd0b-4987-ba9b-96f8ccc49a75 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:39.876063 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-84b6c867-fd0b-4987-ba9b-96f8ccc49a75 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:39.882663 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-84b6c867-fd0b-4987-ba9b-96f8ccc49a75 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:39.883131 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-84b6c867-fd0b-4987-ba9b-96f8ccc49a75 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:39.883896 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-84b6c867-fd0b-4987-ba9b-96f8ccc49a75 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:39.884329 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-84b6c867-fd0b-4987-ba9b-96f8ccc49a75 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:40.176591 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-84b6c867-fd0b-4987-ba9b-96f8ccc49a75 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:40.184619 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-84b6c867-fd0b-4987-ba9b-96f8ccc49a75 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:40.186189 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-84b6c867-fd0b-4987-ba9b-96f8ccc49a75 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:40.187476 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-84b6c867-fd0b-4987-ba9b-96f8ccc49a75 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1725 microversion: 2.20 time: 0.315907 May 26 15:18:40.188028 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 422/810] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:18:39 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1725 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:18:41.206375 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-617d2098-2932-4094-b39e-1a420e300615 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:41.207106 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-617d2098-2932-4094-b39e-1a420e300615 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:41.213402 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-617d2098-2932-4094-b39e-1a420e300615 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:41.213846 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-617d2098-2932-4094-b39e-1a420e300615 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:41.214606 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-617d2098-2932-4094-b39e-1a420e300615 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:41.215037 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-617d2098-2932-4094-b39e-1a420e300615 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:41.390827 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-617d2098-2932-4094-b39e-1a420e300615 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:41.399429 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-617d2098-2932-4094-b39e-1a420e300615 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:41.400950 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-617d2098-2932-4094-b39e-1a420e300615 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:41.402122 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-617d2098-2932-4094-b39e-1a420e300615 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1725 microversion: 2.20 time: 0.199689 May 26 15:18:41.402680 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 389/811] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:18:41 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1725 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:18:42.420533 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-22b8c9a0-af22-4871-91ca-1ef1b38fe37c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:42.421107 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-22b8c9a0-af22-4871-91ca-1ef1b38fe37c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:42.428265 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-22b8c9a0-af22-4871-91ca-1ef1b38fe37c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:42.428709 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-22b8c9a0-af22-4871-91ca-1ef1b38fe37c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:42.429468 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-22b8c9a0-af22-4871-91ca-1ef1b38fe37c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:42.429904 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-22b8c9a0-af22-4871-91ca-1ef1b38fe37c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:42.561893 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-22b8c9a0-af22-4871-91ca-1ef1b38fe37c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:42.569790 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-22b8c9a0-af22-4871-91ca-1ef1b38fe37c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:42.571298 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-22b8c9a0-af22-4871-91ca-1ef1b38fe37c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:42.572446 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-22b8c9a0-af22-4871-91ca-1ef1b38fe37c tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1746 microversion: 2.20 time: 0.155986 May 26 15:18:42.573003 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 423/812] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:18:42 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:18:43.593872 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-39f03e11-be6c-488e-b9b8-a04e78275305 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:43.594475 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-39f03e11-be6c-488e-b9b8-a04e78275305 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:43.602792 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-39f03e11-be6c-488e-b9b8-a04e78275305 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:43.603277 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-39f03e11-be6c-488e-b9b8-a04e78275305 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:43.604063 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-39f03e11-be6c-488e-b9b8-a04e78275305 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:43.604503 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-39f03e11-be6c-488e-b9b8-a04e78275305 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:43.765469 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-39f03e11-be6c-488e-b9b8-a04e78275305 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:43.774611 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-39f03e11-be6c-488e-b9b8-a04e78275305 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:43.776141 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-39f03e11-be6c-488e-b9b8-a04e78275305 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:43.777326 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-39f03e11-be6c-488e-b9b8-a04e78275305 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1746 microversion: 2.20 time: 0.189295 May 26 15:18:43.777871 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 390/813] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:18:43 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1746 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:18:44.796622 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-7f00dffb-84c4-40c0-98f8-6502154adfa3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:44.797230 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-7f00dffb-84c4-40c0-98f8-6502154adfa3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:44.803927 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7f00dffb-84c4-40c0-98f8-6502154adfa3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:44.804431 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7f00dffb-84c4-40c0-98f8-6502154adfa3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:44.805140 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7f00dffb-84c4-40c0-98f8-6502154adfa3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:44.805571 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7f00dffb-84c4-40c0-98f8-6502154adfa3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:44.938750 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-7f00dffb-84c4-40c0-98f8-6502154adfa3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:44.946698 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-7f00dffb-84c4-40c0-98f8-6502154adfa3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:44.948232 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-7f00dffb-84c4-40c0-98f8-6502154adfa3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:44.949504 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-7f00dffb-84c4-40c0-98f8-6502154adfa3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1746 microversion: 2.20 time: 0.156801 May 26 15:18:44.950067 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 424/814] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:18:44 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:18:45.169476 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-12d0b2f5-12c5-47c8-a141-ab85760ff531 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:45.169987 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-12d0b2f5-12c5-47c8-a141-ab85760ff531 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:45.176459 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-12d0b2f5-12c5-47c8-a141-ab85760ff531 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:45.176907 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-12d0b2f5-12c5-47c8-a141-ab85760ff531 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:45.177776 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-12d0b2f5-12c5-47c8-a141-ab85760ff531 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:45.178317 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-12d0b2f5-12c5-47c8-a141-ab85760ff531 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:45.203328 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-12d0b2f5-12c5-47c8-a141-ab85760ff531 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6/ips" status: 200 len: 147 microversion: 2.1 time: 0.037690 May 26 15:18:45.203916 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 391/815] 10.222.0.45 () {58 vars in 1247 bytes} [Thu May 26 15:18:45 2022] GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6/ips => generated 147 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:18:45.783634 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:18:45.783870 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Thu May 26 15:18:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 15:18:45.967958 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-d8ccb016-0102-443e-a2b0-0174fb720bc6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:45.968571 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-d8ccb016-0102-443e-a2b0-0174fb720bc6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:45.975917 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d8ccb016-0102-443e-a2b0-0174fb720bc6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:45.976369 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d8ccb016-0102-443e-a2b0-0174fb720bc6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:45.977135 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d8ccb016-0102-443e-a2b0-0174fb720bc6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:45.977591 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d8ccb016-0102-443e-a2b0-0174fb720bc6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:46.108613 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-d8ccb016-0102-443e-a2b0-0174fb720bc6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:46.117532 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-d8ccb016-0102-443e-a2b0-0174fb720bc6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:46.119049 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-d8ccb016-0102-443e-a2b0-0174fb720bc6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:46.120233 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-d8ccb016-0102-443e-a2b0-0174fb720bc6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1746 microversion: 2.20 time: 0.156238 May 26 15:18:46.120796 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 425/816] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:18:45 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:18:46.479625 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-d01b3ff1-d28b-4221-bb66-84299da50adb req-cbbe494e-072e-4386-9555-c91a6e43bfd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d97e6323-aeef-4755-9bc5-93ae5140640b", "name": "network-vif-plugged", "status": "completed", "tag": "88cc91ef-0c85-4971-928d-0eb2739f6222"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:18:46.489444 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-d01b3ff1-d28b-4221-bb66-84299da50adb req-cbbe494e-072e-4386-9555-c91a6e43bfd1 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:46.490407 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-d01b3ff1-d28b-4221-bb66-84299da50adb req-cbbe494e-072e-4386-9555-c91a6e43bfd1 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:46.501476 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-d01b3ff1-d28b-4221-bb66-84299da50adb req-cbbe494e-072e-4386-9555-c91a6e43bfd1 service nova] Creating event network-vif-plugged:88cc91ef-0c85-4971-928d-0eb2739f6222 for instance d97e6323-aeef-4755-9bc5-93ae5140640b on hv-cinder-84301 May 26 15:18:46.507780 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-d01b3ff1-d28b-4221-bb66-84299da50adb req-cbbe494e-072e-4386-9555-c91a6e43bfd1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032473 May 26 15:18:46.508749 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 392/817] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:18:47.138570 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-60e07684-d6b8-4d30-bcda-1ed76776f16f tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:47.139197 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-60e07684-d6b8-4d30-bcda-1ed76776f16f tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:47.147044 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-60e07684-d6b8-4d30-bcda-1ed76776f16f tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:47.147532 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-60e07684-d6b8-4d30-bcda-1ed76776f16f tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:47.148295 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-60e07684-d6b8-4d30-bcda-1ed76776f16f tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:47.148729 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-60e07684-d6b8-4d30-bcda-1ed76776f16f tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:47.276442 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-60e07684-d6b8-4d30-bcda-1ed76776f16f tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:47.285240 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-60e07684-d6b8-4d30-bcda-1ed76776f16f tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:47.286745 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-60e07684-d6b8-4d30-bcda-1ed76776f16f tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:47.287941 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-60e07684-d6b8-4d30-bcda-1ed76776f16f tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1746 microversion: 2.20 time: 0.153281 May 26 15:18:47.288502 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 426/818] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:18:47 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:18:47.576576 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-0a4d1b1f-5ca7-4cbd-8efc-583b944cc10f tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97a2e881-e6f0-4036-bad2-eab09c19d4d0"}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:18:47.577676 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-0a4d1b1f-5ca7-4cbd-8efc-583b944cc10f tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:47.584571 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0a4d1b1f-5ca7-4cbd-8efc-583b944cc10f tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:47.585015 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0a4d1b1f-5ca7-4cbd-8efc-583b944cc10f tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:47.585790 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0a4d1b1f-5ca7-4cbd-8efc-583b944cc10f tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:47.586222 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0a4d1b1f-5ca7-4cbd-8efc-583b944cc10f tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:47.842145 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-0a4d1b1f-5ca7-4cbd-8efc-583b944cc10f tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "POST /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270123 May 26 15:18:47.843206 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 393/819] 10.222.0.45 () {60 vars in 1322 bytes} [Thu May 26 15:18:47 2022] POST /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:18:48.306194 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-e49bfff7-e0fc-4820-a79a-c93173f2c82f tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:48.306805 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-e49bfff7-e0fc-4820-a79a-c93173f2c82f tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:48.313259 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e49bfff7-e0fc-4820-a79a-c93173f2c82f tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:48.313708 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e49bfff7-e0fc-4820-a79a-c93173f2c82f tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:48.314573 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e49bfff7-e0fc-4820-a79a-c93173f2c82f tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:48.315041 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e49bfff7-e0fc-4820-a79a-c93173f2c82f tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:48.449512 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-e49bfff7-e0fc-4820-a79a-c93173f2c82f tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:48.458609 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-e49bfff7-e0fc-4820-a79a-c93173f2c82f tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:48.460169 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-e49bfff7-e0fc-4820-a79a-c93173f2c82f tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:48.461329 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-e49bfff7-e0fc-4820-a79a-c93173f2c82f tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1746 microversion: 2.20 time: 0.159070 May 26 15:18:48.461893 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 427/820] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:18:48 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:18:49.481979 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-759be3c7-7589-47e1-b970-90ce278c25e7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:49.482662 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-759be3c7-7589-47e1-b970-90ce278c25e7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:49.490139 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-759be3c7-7589-47e1-b970-90ce278c25e7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:49.490581 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-759be3c7-7589-47e1-b970-90ce278c25e7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:49.491363 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-759be3c7-7589-47e1-b970-90ce278c25e7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:49.491794 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-759be3c7-7589-47e1-b970-90ce278c25e7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:49.623269 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-759be3c7-7589-47e1-b970-90ce278c25e7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:49.631209 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-759be3c7-7589-47e1-b970-90ce278c25e7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:49.632718 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-759be3c7-7589-47e1-b970-90ce278c25e7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:49.633881 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-759be3c7-7589-47e1-b970-90ce278c25e7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1746 microversion: 2.20 time: 0.156251 May 26 15:18:49.634442 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 394/821] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:18:49 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:18:50.653211 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-e7b9afd3-2ad1-4995-b48c-f5ee29fd07b7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:50.653815 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-e7b9afd3-2ad1-4995-b48c-f5ee29fd07b7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:50.661133 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e7b9afd3-2ad1-4995-b48c-f5ee29fd07b7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:50.661583 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e7b9afd3-2ad1-4995-b48c-f5ee29fd07b7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:50.662348 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e7b9afd3-2ad1-4995-b48c-f5ee29fd07b7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:50.662777 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e7b9afd3-2ad1-4995-b48c-f5ee29fd07b7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:50.796302 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-e7b9afd3-2ad1-4995-b48c-f5ee29fd07b7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:50.805090 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-e7b9afd3-2ad1-4995-b48c-f5ee29fd07b7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:50.806843 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-e7b9afd3-2ad1-4995-b48c-f5ee29fd07b7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:50.808042 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-e7b9afd3-2ad1-4995-b48c-f5ee29fd07b7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1741 microversion: 2.20 time: 0.158665 May 26 15:18:50.808603 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 428/822] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:18:50 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1741 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:18:51.827536 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-4862bdec-1431-4b81-913f-ce647d3cb6bf tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:51.828912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-4862bdec-1431-4b81-913f-ce647d3cb6bf tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:51.836583 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4862bdec-1431-4b81-913f-ce647d3cb6bf tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:51.837210 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4862bdec-1431-4b81-913f-ce647d3cb6bf tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:51.838066 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4862bdec-1431-4b81-913f-ce647d3cb6bf tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:51.838576 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4862bdec-1431-4b81-913f-ce647d3cb6bf tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:51.983316 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-4862bdec-1431-4b81-913f-ce647d3cb6bf tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:51.991910 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-4862bdec-1431-4b81-913f-ce647d3cb6bf tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:51.993746 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-4862bdec-1431-4b81-913f-ce647d3cb6bf tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:51.994992 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-4862bdec-1431-4b81-913f-ce647d3cb6bf tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1741 microversion: 2.20 time: 0.171561 May 26 15:18:51.996028 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 395/823] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:18:51 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1741 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:18:53.015164 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-666759b7-777d-4782-a07f-330537408117 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:53.015767 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-666759b7-777d-4782-a07f-330537408117 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:53.023409 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-666759b7-777d-4782-a07f-330537408117 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:53.023859 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-666759b7-777d-4782-a07f-330537408117 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:53.024826 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-666759b7-777d-4782-a07f-330537408117 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:53.025429 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-666759b7-777d-4782-a07f-330537408117 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:53.204749 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-666759b7-777d-4782-a07f-330537408117 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:53.215314 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-666759b7-777d-4782-a07f-330537408117 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:53.216778 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-666759b7-777d-4782-a07f-330537408117 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:53.218002 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-666759b7-777d-4782-a07f-330537408117 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1741 microversion: 2.20 time: 0.206798 May 26 15:18:53.218760 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 429/824] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:18:53 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1741 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:18:54.237961 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-7eb5aae0-3a26-459c-9904-573c9fd2a991 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:54.238552 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-7eb5aae0-3a26-459c-9904-573c9fd2a991 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:54.245512 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7eb5aae0-3a26-459c-9904-573c9fd2a991 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:54.246172 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7eb5aae0-3a26-459c-9904-573c9fd2a991 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:54.247242 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7eb5aae0-3a26-459c-9904-573c9fd2a991 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:54.247674 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7eb5aae0-3a26-459c-9904-573c9fd2a991 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:54.420745 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7eb5aae0-3a26-459c-9904-573c9fd2a991 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:54.429828 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7eb5aae0-3a26-459c-9904-573c9fd2a991 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:54.431372 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7eb5aae0-3a26-459c-9904-573c9fd2a991 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:54.432561 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-7eb5aae0-3a26-459c-9904-573c9fd2a991 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1741 microversion: 2.20 time: 0.199388 May 26 15:18:54.433127 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 396/825] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:18:54 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1741 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:18:55.452501 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-7d405eac-8a62-44f1-818f-a8c1f7c3cd27 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:55.453640 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-7d405eac-8a62-44f1-818f-a8c1f7c3cd27 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:55.461662 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7d405eac-8a62-44f1-818f-a8c1f7c3cd27 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:55.462005 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7d405eac-8a62-44f1-818f-a8c1f7c3cd27 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:55.462776 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7d405eac-8a62-44f1-818f-a8c1f7c3cd27 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:55.463293 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7d405eac-8a62-44f1-818f-a8c1f7c3cd27 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:55.464048 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-abe4fffe-d5b0-4373-95ae-0d41e87283f0 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:55.465279 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-abe4fffe-d5b0-4373-95ae-0d41e87283f0 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:55.472800 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-abe4fffe-d5b0-4373-95ae-0d41e87283f0 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:55.473337 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-abe4fffe-d5b0-4373-95ae-0d41e87283f0 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:55.474237 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-abe4fffe-d5b0-4373-95ae-0d41e87283f0 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:55.474747 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-abe4fffe-d5b0-4373-95ae-0d41e87283f0 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:55.477561 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:18:55.509744 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-abe4fffe-d5b0-4373-95ae-0d41e87283f0 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049831 May 26 15:18:55.510673 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 397/826] 10.222.0.45 () {58 vars in 1301 bytes} [Thu May 26 15:18:55 2022] GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:18:55.524090 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ea78c56b-abea-4f4d-8f0f-278e17b3ccc7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:55.524573 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ea78c56b-abea-4f4d-8f0f-278e17b3ccc7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:55.530686 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ea78c56b-abea-4f4d-8f0f-278e17b3ccc7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:55.531153 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ea78c56b-abea-4f4d-8f0f-278e17b3ccc7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:55.531910 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ea78c56b-abea-4f4d-8f0f-278e17b3ccc7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:55.532337 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ea78c56b-abea-4f4d-8f0f-278e17b3ccc7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:55.565551 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ea78c56b-abea-4f4d-8f0f-278e17b3ccc7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6/os-volume_attachments/97a2e881-e6f0-4036-bad2-eab09c19d4d0" status: 200 len: 194 microversion: 2.1 time: 0.045055 May 26 15:18:55.566897 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 398/827] 10.222.0.45 () {58 vars in 1412 bytes} [Thu May 26 15:18:55 2022] GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6/os-volume_attachments/97a2e881-e6f0-4036-bad2-eab09c19d4d0 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:18:55.625958 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-7d405eac-8a62-44f1-818f-a8c1f7c3cd27 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:55.642193 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-7d405eac-8a62-44f1-818f-a8c1f7c3cd27 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:55.644523 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-7d405eac-8a62-44f1-818f-a8c1f7c3cd27 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:55.645827 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-7d405eac-8a62-44f1-818f-a8c1f7c3cd27 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1741 microversion: 2.20 time: 0.197356 May 26 15:18:55.646619 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 430/828] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:18:55 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1741 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:18:56.665584 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-8ae211bc-5bc8-4483-93b4-01ae102a1257 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:56.666283 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-8ae211bc-5bc8-4483-93b4-01ae102a1257 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:56.672791 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8ae211bc-5bc8-4483-93b4-01ae102a1257 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:56.673227 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8ae211bc-5bc8-4483-93b4-01ae102a1257 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:56.675133 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8ae211bc-5bc8-4483-93b4-01ae102a1257 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:56.675573 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8ae211bc-5bc8-4483-93b4-01ae102a1257 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:56.807303 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-8ae211bc-5bc8-4483-93b4-01ae102a1257 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:56.815475 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-8ae211bc-5bc8-4483-93b4-01ae102a1257 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:56.817214 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-8ae211bc-5bc8-4483-93b4-01ae102a1257 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:56.818579 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-8ae211bc-5bc8-4483-93b4-01ae102a1257 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1741 microversion: 2.20 time: 0.156893 May 26 15:18:56.819153 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 399/829] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:18:56 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1741 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:18:56.994802 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-eeb052dd-46b7-4767-9110-e7c6b2da80fd tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4668fdaf-97ff-4616-a008-dff42e8e6af0"}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:18:56.996071 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-eeb052dd-46b7-4767-9110-e7c6b2da80fd tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:57.003315 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-eeb052dd-46b7-4767-9110-e7c6b2da80fd tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:57.003765 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-eeb052dd-46b7-4767-9110-e7c6b2da80fd tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:57.004527 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-eeb052dd-46b7-4767-9110-e7c6b2da80fd tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:57.004961 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-eeb052dd-46b7-4767-9110-e7c6b2da80fd tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:57.272896 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-eeb052dd-46b7-4767-9110-e7c6b2da80fd tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "POST /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281808 May 26 15:18:57.273538 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 431/830] 10.222.0.45 () {60 vars in 1322 bytes} [Thu May 26 15:18:56 2022] POST /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:18:57.838360 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-9a5b592f-fabd-49cf-9e34-98747d6d2485 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:57.838963 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-9a5b592f-fabd-49cf-9e34-98747d6d2485 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:57.846647 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9a5b592f-fabd-49cf-9e34-98747d6d2485 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:57.847200 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9a5b592f-fabd-49cf-9e34-98747d6d2485 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:57.848259 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9a5b592f-fabd-49cf-9e34-98747d6d2485 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:57.848751 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9a5b592f-fabd-49cf-9e34-98747d6d2485 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:57.990705 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-9a5b592f-fabd-49cf-9e34-98747d6d2485 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:58.004330 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-9a5b592f-fabd-49cf-9e34-98747d6d2485 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:58.005865 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-9a5b592f-fabd-49cf-9e34-98747d6d2485 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:58.006428 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-9a5b592f-fabd-49cf-9e34-98747d6d2485 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1741 microversion: 2.20 time: 0.172312 May 26 15:18:58.007354 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 400/831] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:18:57 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1741 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:18:59.030363 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-eb8facd6-3b52-4406-b1ea-6f6194953cf7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:59.032133 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-eb8facd6-3b52-4406-b1ea-6f6194953cf7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:59.040857 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-eb8facd6-3b52-4406-b1ea-6f6194953cf7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:59.041770 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-eb8facd6-3b52-4406-b1ea-6f6194953cf7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:59.042335 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-eb8facd6-3b52-4406-b1ea-6f6194953cf7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:59.042773 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-eb8facd6-3b52-4406-b1ea-6f6194953cf7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:59.059653 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:18:59.193311 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-eb8facd6-3b52-4406-b1ea-6f6194953cf7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:59.203392 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-eb8facd6-3b52-4406-b1ea-6f6194953cf7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:59.205082 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-eb8facd6-3b52-4406-b1ea-6f6194953cf7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:59.206955 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-eb8facd6-3b52-4406-b1ea-6f6194953cf7 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1741 microversion: 2.20 time: 0.183588 May 26 15:18:59.211145 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 432/832] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:18:59 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1741 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:19:00.226282 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-7d3d806d-88ac-493c-8609-dbd7dde8cdd5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:00.227053 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-7d3d806d-88ac-493c-8609-dbd7dde8cdd5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:00.233513 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7d3d806d-88ac-493c-8609-dbd7dde8cdd5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:00.234042 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7d3d806d-88ac-493c-8609-dbd7dde8cdd5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:00.234956 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7d3d806d-88ac-493c-8609-dbd7dde8cdd5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:00.235459 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7d3d806d-88ac-493c-8609-dbd7dde8cdd5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:00.392581 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7d3d806d-88ac-493c-8609-dbd7dde8cdd5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:00.401557 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7d3d806d-88ac-493c-8609-dbd7dde8cdd5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:00.403063 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7d3d806d-88ac-493c-8609-dbd7dde8cdd5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:00.404463 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-7d3d806d-88ac-493c-8609-dbd7dde8cdd5 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1741 microversion: 2.20 time: 0.182556 May 26 15:19:00.415352 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 401/833] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:19:00 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1741 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:19:01.578424 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-fa7484d2-6d93-4ca1-af85-bd77b8909432 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:01.579036 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-fa7484d2-6d93-4ca1-af85-bd77b8909432 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:01.581047 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_api:SELECT=30 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:19:01.586754 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fa7484d2-6d93-4ca1-af85-bd77b8909432 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:01.587218 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fa7484d2-6d93-4ca1-af85-bd77b8909432 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:01.587995 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fa7484d2-6d93-4ca1-af85-bd77b8909432 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:01.588435 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fa7484d2-6d93-4ca1-af85-bd77b8909432 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:01.724528 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-fa7484d2-6d93-4ca1-af85-bd77b8909432 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:01.733311 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-fa7484d2-6d93-4ca1-af85-bd77b8909432 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:01.734850 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-fa7484d2-6d93-4ca1-af85-bd77b8909432 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:01.736091 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-fa7484d2-6d93-4ca1-af85-bd77b8909432 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1741 microversion: 2.20 time: 0.315887 May 26 15:19:01.737387 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 433/834] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:19:01 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1741 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:19:02.756603 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-2e24ffb7-6a17-45f6-a80a-c83dbad75da3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:02.757314 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-2e24ffb7-6a17-45f6-a80a-c83dbad75da3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:02.759665 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=34 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:19:02.765004 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2e24ffb7-6a17-45f6-a80a-c83dbad75da3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:02.765479 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2e24ffb7-6a17-45f6-a80a-c83dbad75da3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:02.766253 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2e24ffb7-6a17-45f6-a80a-c83dbad75da3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:02.767041 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2e24ffb7-6a17-45f6-a80a-c83dbad75da3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:02.911725 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2e24ffb7-6a17-45f6-a80a-c83dbad75da3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:02.920141 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2e24ffb7-6a17-45f6-a80a-c83dbad75da3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:02.921882 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2e24ffb7-6a17-45f6-a80a-c83dbad75da3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:02.924367 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-2e24ffb7-6a17-45f6-a80a-c83dbad75da3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1741 microversion: 2.20 time: 0.171667 May 26 15:19:02.929756 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 402/835] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:19:02 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1741 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:19:03.943443 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-97605119-b92c-40da-8199-5866b16538b3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:03.944001 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-97605119-b92c-40da-8199-5866b16538b3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:03.950753 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-97605119-b92c-40da-8199-5866b16538b3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:03.951234 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-97605119-b92c-40da-8199-5866b16538b3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:03.952024 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-97605119-b92c-40da-8199-5866b16538b3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:03.952644 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-97605119-b92c-40da-8199-5866b16538b3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:04.094191 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-97605119-b92c-40da-8199-5866b16538b3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:04.102224 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-97605119-b92c-40da-8199-5866b16538b3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:04.103829 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-97605119-b92c-40da-8199-5866b16538b3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:04.105029 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-97605119-b92c-40da-8199-5866b16538b3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1741 microversion: 2.20 time: 0.166608 May 26 15:19:04.105601 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 434/836] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:19:03 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1741 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:19:04.854709 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-3d79bc24-6e8f-4683-813f-56d0f5b5b33e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:04.855676 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-3d79bc24-6e8f-4683-813f-56d0f5b5b33e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:04.863852 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3d79bc24-6e8f-4683-813f-56d0f5b5b33e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:04.864306 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3d79bc24-6e8f-4683-813f-56d0f5b5b33e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:04.865168 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3d79bc24-6e8f-4683-813f-56d0f5b5b33e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:04.865688 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3d79bc24-6e8f-4683-813f-56d0f5b5b33e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:04.900913 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-3d79bc24-6e8f-4683-813f-56d0f5b5b33e tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050205 May 26 15:19:04.905982 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 403/837] 10.222.0.45 () {58 vars in 1301 bytes} [Thu May 26 15:19:04 2022] GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:19:05.014006 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-a9b559f2-59c5-4747-91a7-e642712b5bba tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:05.014526 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-a9b559f2-59c5-4747-91a7-e642712b5bba tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:05.022389 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a9b559f2-59c5-4747-91a7-e642712b5bba tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:05.022845 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a9b559f2-59c5-4747-91a7-e642712b5bba tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:05.023649 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a9b559f2-59c5-4747-91a7-e642712b5bba tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:05.024089 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a9b559f2-59c5-4747-91a7-e642712b5bba tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:05.060769 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-a9b559f2-59c5-4747-91a7-e642712b5bba tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6/os-volume_attachments/97a2e881-e6f0-4036-bad2-eab09c19d4d0" status: 200 len: 194 microversion: 2.1 time: 0.052909 May 26 15:19:05.061981 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 435/838] 10.222.0.45 () {58 vars in 1412 bytes} [Thu May 26 15:19:05 2022] GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6/os-volume_attachments/97a2e881-e6f0-4036-bad2-eab09c19d4d0 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:19:05.073960 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d791d715-8510-4054-ab83-77c3eff9acfe tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:05.074719 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-d791d715-8510-4054-ab83-77c3eff9acfe tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:05.082562 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d791d715-8510-4054-ab83-77c3eff9acfe tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:05.083005 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d791d715-8510-4054-ab83-77c3eff9acfe tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:05.083817 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d791d715-8510-4054-ab83-77c3eff9acfe tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:05.084257 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d791d715-8510-4054-ab83-77c3eff9acfe tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:05.128354 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-0f18700e-4031-4ee8-98b1-c69e8a0f6ff9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:05.129365 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-0f18700e-4031-4ee8-98b1-c69e8a0f6ff9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:05.136217 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0f18700e-4031-4ee8-98b1-c69e8a0f6ff9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:05.136635 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0f18700e-4031-4ee8-98b1-c69e8a0f6ff9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:05.137629 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0f18700e-4031-4ee8-98b1-c69e8a0f6ff9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:05.138414 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0f18700e-4031-4ee8-98b1-c69e8a0f6ff9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:05.179915 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.objects.instance [None req-d791d715-8510-4054-ab83-77c3eff9acfe tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lazy-loading 'services' on Instance uuid 183130d4-7caf-4ba9-a0d1-69e8187f36c6 {{(pid=117798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:19:05.298429 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-d791d715-8510-4054-ab83-77c3eff9acfe tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "DELETE /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6/os-volume_attachments/97a2e881-e6f0-4036-bad2-eab09c19d4d0" status: 202 len: 0 microversion: 2.1 time: 0.229774 May 26 15:19:05.303081 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 404/839] 10.222.0.45 () {58 vars in 1415 bytes} [Thu May 26 15:19:05 2022] DELETE /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6/os-volume_attachments/97a2e881-e6f0-4036-bad2-eab09c19d4d0 => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:19:05.336757 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-0f18700e-4031-4ee8-98b1-c69e8a0f6ff9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:05.360243 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-0f18700e-4031-4ee8-98b1-c69e8a0f6ff9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:05.362565 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-0f18700e-4031-4ee8-98b1-c69e8a0f6ff9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:05.364041 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-0f18700e-4031-4ee8-98b1-c69e8a0f6ff9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1741 microversion: 2.20 time: 0.244157 May 26 15:19:05.377185 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 436/840] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:19:05 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1741 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:19:06.386042 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-fe0be40a-76c5-4942-b4dd-227a71f9ad0a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:06.386625 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-fe0be40a-76c5-4942-b4dd-227a71f9ad0a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:06.394060 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fe0be40a-76c5-4942-b4dd-227a71f9ad0a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:06.394504 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fe0be40a-76c5-4942-b4dd-227a71f9ad0a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:06.395304 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fe0be40a-76c5-4942-b4dd-227a71f9ad0a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:06.395764 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fe0be40a-76c5-4942-b4dd-227a71f9ad0a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:06.531803 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-fe0be40a-76c5-4942-b4dd-227a71f9ad0a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:06.540800 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-fe0be40a-76c5-4942-b4dd-227a71f9ad0a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:06.542278 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-fe0be40a-76c5-4942-b4dd-227a71f9ad0a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:06.543442 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-fe0be40a-76c5-4942-b4dd-227a71f9ad0a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1741 microversion: 2.20 time: 0.162465 May 26 15:19:06.544048 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 405/841] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:19:06 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1741 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:19:07.502817 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-ecc11cb1-e4b4-41b0-b588-81372d01fe81 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:07.503505 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-ecc11cb1-e4b4-41b0-b588-81372d01fe81 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:07.510287 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ecc11cb1-e4b4-41b0-b588-81372d01fe81 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:07.510723 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ecc11cb1-e4b4-41b0-b588-81372d01fe81 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:07.511537 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ecc11cb1-e4b4-41b0-b588-81372d01fe81 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:07.511980 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ecc11cb1-e4b4-41b0-b588-81372d01fe81 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:07.543196 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-ecc11cb1-e4b4-41b0-b588-81372d01fe81 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6/os-volume_attachments/4668fdaf-97ff-4616-a008-dff42e8e6af0" status: 200 len: 194 microversion: 2.1 time: 0.045965 May 26 15:19:07.543792 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 437/842] 10.222.0.45 () {58 vars in 1412 bytes} [Thu May 26 15:19:07 2022] GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6/os-volume_attachments/4668fdaf-97ff-4616-a008-dff42e8e6af0 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:19:07.554811 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ea12d7d5-03f1-4fec-8c95-7c6d4bd4e83a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:07.555354 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ea12d7d5-03f1-4fec-8c95-7c6d4bd4e83a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:07.562186 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ea12d7d5-03f1-4fec-8c95-7c6d4bd4e83a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:07.562374 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-62c6a577-3e37-4557-a267-c03da1e4c862 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:07.562635 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ea12d7d5-03f1-4fec-8c95-7c6d4bd4e83a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:07.563012 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-62c6a577-3e37-4557-a267-c03da1e4c862 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:07.563429 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ea12d7d5-03f1-4fec-8c95-7c6d4bd4e83a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:07.563863 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ea12d7d5-03f1-4fec-8c95-7c6d4bd4e83a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:07.570103 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-62c6a577-3e37-4557-a267-c03da1e4c862 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:07.570555 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-62c6a577-3e37-4557-a267-c03da1e4c862 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:07.571381 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-62c6a577-3e37-4557-a267-c03da1e4c862 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:07.571820 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-62c6a577-3e37-4557-a267-c03da1e4c862 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:07.648128 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.objects.instance [None req-ea12d7d5-03f1-4fec-8c95-7c6d4bd4e83a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lazy-loading 'services' on Instance uuid 183130d4-7caf-4ba9-a0d1-69e8187f36c6 {{(pid=117798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:19:07.708747 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-62c6a577-3e37-4557-a267-c03da1e4c862 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:07.717464 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-62c6a577-3e37-4557-a267-c03da1e4c862 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:07.719053 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-62c6a577-3e37-4557-a267-c03da1e4c862 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:07.720980 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-62c6a577-3e37-4557-a267-c03da1e4c862 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1723 microversion: 2.20 time: 0.162055 May 26 15:19:07.721682 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 438/843] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:19:07 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:19:07.722247 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ea12d7d5-03f1-4fec-8c95-7c6d4bd4e83a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "DELETE /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6/os-volume_attachments/4668fdaf-97ff-4616-a008-dff42e8e6af0" status: 202 len: 0 microversion: 2.1 time: 0.171748 May 26 15:19:07.722840 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 406/844] 10.222.0.45 () {58 vars in 1415 bytes} [Thu May 26 15:19:07 2022] DELETE /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6/os-volume_attachments/4668fdaf-97ff-4616-a008-dff42e8e6af0 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:19:08.739874 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-3860055d-84a0-4131-a204-98a8f9c38867 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:08.740512 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-3860055d-84a0-4131-a204-98a8f9c38867 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:08.746978 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-3860055d-84a0-4131-a204-98a8f9c38867 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:08.747457 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-3860055d-84a0-4131-a204-98a8f9c38867 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:08.748221 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-3860055d-84a0-4131-a204-98a8f9c38867 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:08.748662 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-3860055d-84a0-4131-a204-98a8f9c38867 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:08.883010 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-3860055d-84a0-4131-a204-98a8f9c38867 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:08.891291 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-3860055d-84a0-4131-a204-98a8f9c38867 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:08.893211 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-3860055d-84a0-4131-a204-98a8f9c38867 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:08.894402 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-3860055d-84a0-4131-a204-98a8f9c38867 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1723 microversion: 2.20 time: 0.158464 May 26 15:19:08.894964 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 439/845] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:19:08 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:19:09.915028 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-cda015d6-d568-4564-8286-8c2f4189bcb0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:09.915741 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-cda015d6-d568-4564-8286-8c2f4189bcb0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:09.922124 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cda015d6-d568-4564-8286-8c2f4189bcb0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:09.922572 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cda015d6-d568-4564-8286-8c2f4189bcb0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:09.923385 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cda015d6-d568-4564-8286-8c2f4189bcb0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:09.923822 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cda015d6-d568-4564-8286-8c2f4189bcb0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:10.070790 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-cda015d6-d568-4564-8286-8c2f4189bcb0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:10.080291 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-cda015d6-d568-4564-8286-8c2f4189bcb0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:10.082167 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-cda015d6-d568-4564-8286-8c2f4189bcb0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:10.083382 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-cda015d6-d568-4564-8286-8c2f4189bcb0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1723 microversion: 2.20 time: 0.173026 May 26 15:19:10.083948 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 407/846] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:19:09 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:19:10.513087 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-4cfe0daf-31a5-4210-b159-c4537e8ff2b6 req-ceb6c19c-ba77-4e27-ac7a-cba0abcc6f1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d97e6323-aeef-4755-9bc5-93ae5140640b", "name": "network-vif-unplugged", "status": "completed", "tag": "88cc91ef-0c85-4971-928d-0eb2739f6222"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:19:10.523822 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-4cfe0daf-31a5-4210-b159-c4537e8ff2b6 req-ceb6c19c-ba77-4e27-ac7a-cba0abcc6f1a service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:10.524277 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-4cfe0daf-31a5-4210-b159-c4537e8ff2b6 req-ceb6c19c-ba77-4e27-ac7a-cba0abcc6f1a service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:10.540118 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.compute.server_external_events [req-4cfe0daf-31a5-4210-b159-c4537e8ff2b6 req-ceb6c19c-ba77-4e27-ac7a-cba0abcc6f1a service nova] Unable to find a host for instance d97e6323-aeef-4755-9bc5-93ae5140640b. Dropping event network-vif-unplugged {{(pid=117799) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 26 15:19:10.541182 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-4cfe0daf-31a5-4210-b159-c4537e8ff2b6 req-ceb6c19c-ba77-4e27-ac7a-cba0abcc6f1a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031841 May 26 15:19:10.541963 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 440/847] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 26 15:19:10.991603 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-4d943114-dad4-4831-8072-6c50fc0342a6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:10.992599 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-4d943114-dad4-4831-8072-6c50fc0342a6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:10.999055 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4d943114-dad4-4831-8072-6c50fc0342a6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:10.999530 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4d943114-dad4-4831-8072-6c50fc0342a6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:11.000290 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4d943114-dad4-4831-8072-6c50fc0342a6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:11.000721 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4d943114-dad4-4831-8072-6c50fc0342a6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:11.029822 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-4d943114-dad4-4831-8072-6c50fc0342a6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042059 May 26 15:19:11.030383 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 408/848] 10.222.0.45 () {58 vars in 1301 bytes} [Thu May 26 15:19:10 2022] GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 15:19:11.102938 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-18602fde-12ef-42b2-b90d-f7204f3eb9ca tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:11.103656 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-18602fde-12ef-42b2-b90d-f7204f3eb9ca tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:11.110163 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-18602fde-12ef-42b2-b90d-f7204f3eb9ca tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:11.110619 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-18602fde-12ef-42b2-b90d-f7204f3eb9ca tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:11.111449 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-18602fde-12ef-42b2-b90d-f7204f3eb9ca tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:11.111888 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-18602fde-12ef-42b2-b90d-f7204f3eb9ca tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:11.145738 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-cf7f36a3-4bd1-4a97-a1ed-f8bf25e31f4d tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:11.145738 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-cf7f36a3-4bd1-4a97-a1ed-f8bf25e31f4d tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:11.151042 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cf7f36a3-4bd1-4a97-a1ed-f8bf25e31f4d tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:11.151711 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cf7f36a3-4bd1-4a97-a1ed-f8bf25e31f4d tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:11.152549 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cf7f36a3-4bd1-4a97-a1ed-f8bf25e31f4d tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:11.152979 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cf7f36a3-4bd1-4a97-a1ed-f8bf25e31f4d tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:11.182932 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-cf7f36a3-4bd1-4a97-a1ed-f8bf25e31f4d tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045206 May 26 15:19:11.183532 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 409/849] 10.222.0.45 () {58 vars in 1301 bytes} [Thu May 26 15:19:11 2022] GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 15:19:11.243555 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-18602fde-12ef-42b2-b90d-f7204f3eb9ca tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:11.243728 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-bfc13b03-d0a9-4aa9-be16-6f90e3bb116d tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:11.244092 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-bfc13b03-d0a9-4aa9-be16-6f90e3bb116d tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:11.250102 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bfc13b03-d0a9-4aa9-be16-6f90e3bb116d tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:11.250547 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bfc13b03-d0a9-4aa9-be16-6f90e3bb116d tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:11.251324 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bfc13b03-d0a9-4aa9-be16-6f90e3bb116d tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:11.251981 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-18602fde-12ef-42b2-b90d-f7204f3eb9ca tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:11.252315 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bfc13b03-d0a9-4aa9-be16-6f90e3bb116d tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:11.253700 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-18602fde-12ef-42b2-b90d-f7204f3eb9ca tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:11.254864 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-18602fde-12ef-42b2-b90d-f7204f3eb9ca tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1666 microversion: 2.20 time: 0.155901 May 26 15:19:11.255472 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 441/850] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:19:11 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1666 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:19:11.273125 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-b195aacb-14d8-41b8-ab8c-d00aabe9ed86 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "faf53001-9411-44e4-b0de-50e6b210d66b"}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:19:11.274171 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-b195aacb-14d8-41b8-ab8c-d00aabe9ed86 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:11.278467 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-bfc13b03-d0a9-4aa9-be16-6f90e3bb116d tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Going to try to terminate instance {{(pid=117798) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:19:11.280151 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b195aacb-14d8-41b8-ab8c-d00aabe9ed86 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:11.280598 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b195aacb-14d8-41b8-ab8c-d00aabe9ed86 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:11.281365 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b195aacb-14d8-41b8-ab8c-d00aabe9ed86 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:11.281796 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b195aacb-14d8-41b8-ab8c-d00aabe9ed86 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:11.330249 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:19:11.358658 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-bfc13b03-d0a9-4aa9-be16-6f90e3bb116d tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "DELETE /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6" status: 204 len: 0 microversion: 2.1 time: 0.118941 May 26 15:19:11.359330 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 410/851] 10.222.0.45 () {58 vars in 1238 bytes} [Thu May 26 15:19:11 2022] DELETE /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 15:19:11.369487 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-eb081a26-7c41-4ea1-b62c-d287fd260bfa tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:11.369728 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-eb081a26-7c41-4ea1-b62c-d287fd260bfa tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:11.375584 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-eb081a26-7c41-4ea1-b62c-d287fd260bfa tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:11.376037 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-eb081a26-7c41-4ea1-b62c-d287fd260bfa tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:11.376936 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-eb081a26-7c41-4ea1-b62c-d287fd260bfa tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:11.377592 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-eb081a26-7c41-4ea1-b62c-d287fd260bfa tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:11.523328 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-eb081a26-7c41-4ea1-b62c-d287fd260bfa tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:11.531007 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-eb081a26-7c41-4ea1-b62c-d287fd260bfa tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6" status: 200 len: 1676 microversion: 2.1 time: 0.166889 May 26 15:19:11.531685 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 411/852] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:19:11 2022] GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6 => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:19:11.570940 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-b195aacb-14d8-41b8-ab8c-d00aabe9ed86 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "POST /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.301606 May 26 15:19:11.571614 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 442/853] 10.222.0.45 () {62 vars in 1363 bytes} [Thu May 26 15:19:11 2022] POST /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b/os-volume_attachments => generated 188 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 15:19:11.686365 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d3b1c5dd-cd42-4148-bd91-055e055206ef tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:11.686858 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-d3b1c5dd-cd42-4148-bd91-055e055206ef tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:11.693499 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d3b1c5dd-cd42-4148-bd91-055e055206ef tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:11.693945 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d3b1c5dd-cd42-4148-bd91-055e055206ef tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:11.694702 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d3b1c5dd-cd42-4148-bd91-055e055206ef tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:11.695164 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d3b1c5dd-cd42-4148-bd91-055e055206ef tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:11.929940 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-d3b1c5dd-cd42-4148-bd91-055e055206ef tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b/os-volume_attachments/faf53001-9411-44e4-b0de-50e6b210d66b" status: 202 len: 0 microversion: 2.20 time: 0.247361 May 26 15:19:11.930467 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 412/854] 10.222.0.45 () {60 vars in 1456 bytes} [Thu May 26 15:19:11 2022] DELETE /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b/os-volume_attachments/faf53001-9411-44e4-b0de-50e6b210d66b => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 15:19:11.987916 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-b3214984-0d68-4277-b13d-406962d015f1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:19:11.988482 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-b3214984-0d68-4277-b13d-406962d015f1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:11.994499 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b3214984-0d68-4277-b13d-406962d015f1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:11.994953 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b3214984-0d68-4277-b13d-406962d015f1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:11.995770 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b3214984-0d68-4277-b13d-406962d015f1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:11.996204 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b3214984-0d68-4277-b13d-406962d015f1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:12.077380 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-b3214984-0d68-4277-b13d-406962d015f1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "POST /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b/action" status: 202 len: 0 microversion: 2.20 time: 0.093322 May 26 15:19:12.078004 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 443/855] 10.222.0.45 () {62 vars in 1318 bytes} [Thu May 26 15:19:11 2022] POST /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 15:19:12.087096 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a5951701-8e7e-44e2-b45c-2016e198b71d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:12.087705 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a5951701-8e7e-44e2-b45c-2016e198b71d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:12.096847 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a5951701-8e7e-44e2-b45c-2016e198b71d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:12.097324 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a5951701-8e7e-44e2-b45c-2016e198b71d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:12.098132 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a5951701-8e7e-44e2-b45c-2016e198b71d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:12.098625 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a5951701-8e7e-44e2-b45c-2016e198b71d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:12.232767 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a5951701-8e7e-44e2-b45c-2016e198b71d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:12.241044 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a5951701-8e7e-44e2-b45c-2016e198b71d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:12.242584 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a5951701-8e7e-44e2-b45c-2016e198b71d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:12.243786 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a5951701-8e7e-44e2-b45c-2016e198b71d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1674 microversion: 2.20 time: 0.160759 May 26 15:19:12.250800 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 413/856] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:19:12 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:19:12.548867 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-dfa69c82-4ff9-4935-ba11-aa58c88c678a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:12.549514 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-dfa69c82-4ff9-4935-ba11-aa58c88c678a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:12.556062 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dfa69c82-4ff9-4935-ba11-aa58c88c678a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:12.556516 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dfa69c82-4ff9-4935-ba11-aa58c88c678a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:12.557287 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dfa69c82-4ff9-4935-ba11-aa58c88c678a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:12.557721 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dfa69c82-4ff9-4935-ba11-aa58c88c678a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:12.730273 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-dfa69c82-4ff9-4935-ba11-aa58c88c678a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:12.738051 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-dfa69c82-4ff9-4935-ba11-aa58c88c678a tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6" status: 200 len: 1676 microversion: 2.1 time: 0.193631 May 26 15:19:12.738647 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 444/857] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:19:12 2022] GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6 => generated 1676 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:19:13.263660 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a089f332-7907-44db-84d3-c54e9b6484d3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:13.264267 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a089f332-7907-44db-84d3-c54e9b6484d3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:13.272006 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a089f332-7907-44db-84d3-c54e9b6484d3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:13.272450 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a089f332-7907-44db-84d3-c54e9b6484d3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:13.273215 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a089f332-7907-44db-84d3-c54e9b6484d3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:13.273654 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a089f332-7907-44db-84d3-c54e9b6484d3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:13.409339 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a089f332-7907-44db-84d3-c54e9b6484d3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:13.417268 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a089f332-7907-44db-84d3-c54e9b6484d3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:13.418813 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a089f332-7907-44db-84d3-c54e9b6484d3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:13.420042 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a089f332-7907-44db-84d3-c54e9b6484d3 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1676 microversion: 2.20 time: 0.160757 May 26 15:19:13.420611 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 414/858] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:19:13 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:19:13.755512 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-ee40a8a8-a8aa-430e-a125-4b293b891450 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:13.756132 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-ee40a8a8-a8aa-430e-a125-4b293b891450 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:13.762784 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ee40a8a8-a8aa-430e-a125-4b293b891450 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:13.763277 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ee40a8a8-a8aa-430e-a125-4b293b891450 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:13.764049 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ee40a8a8-a8aa-430e-a125-4b293b891450 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:13.764488 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ee40a8a8-a8aa-430e-a125-4b293b891450 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:13.894374 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-ee40a8a8-a8aa-430e-a125-4b293b891450 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:13.896700 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:19:13.904031 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-ee40a8a8-a8aa-430e-a125-4b293b891450 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6" status: 200 len: 1676 microversion: 2.1 time: 0.152534 May 26 15:19:13.904607 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 445/859] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:19:13 2022] GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:19:14.439473 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f8535607-1ccd-4396-a3d4-4a2975508241 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:14.440772 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f8535607-1ccd-4396-a3d4-4a2975508241 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:14.452235 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f8535607-1ccd-4396-a3d4-4a2975508241 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:14.452681 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f8535607-1ccd-4396-a3d4-4a2975508241 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:14.453464 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f8535607-1ccd-4396-a3d4-4a2975508241 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:14.453900 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f8535607-1ccd-4396-a3d4-4a2975508241 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:14.674946 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f8535607-1ccd-4396-a3d4-4a2975508241 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:14.683225 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f8535607-1ccd-4396-a3d4-4a2975508241 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:14.685669 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f8535607-1ccd-4396-a3d4-4a2975508241 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:14.686566 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f8535607-1ccd-4396-a3d4-4a2975508241 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1732 microversion: 2.20 time: 0.251073 May 26 15:19:14.698128 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 415/860] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:19:14 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1732 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:19:14.924408 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-5686ac98-793c-4aeb-8bd0-9f3adfb1bbe3 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:14.925020 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-5686ac98-793c-4aeb-8bd0-9f3adfb1bbe3 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:14.932144 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5686ac98-793c-4aeb-8bd0-9f3adfb1bbe3 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:14.932602 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5686ac98-793c-4aeb-8bd0-9f3adfb1bbe3 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:14.933382 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5686ac98-793c-4aeb-8bd0-9f3adfb1bbe3 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:14.933815 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5686ac98-793c-4aeb-8bd0-9f3adfb1bbe3 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:15.154978 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-97392ea2-6e9f-44a5-8ed9-30c1bff7e482 req-3ae9d3fe-a3d6-4668-8642-4c88a900ca8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "183130d4-7caf-4ba9-a0d1-69e8187f36c6", "name": "network-vif-deleted", "tag": "5907d8a5-d1b3-410e-9e64-143578f4b9e5"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:19:15.175171 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-97392ea2-6e9f-44a5-8ed9-30c1bff7e482 req-3ae9d3fe-a3d6-4668-8642-4c88a900ca8e service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:15.175993 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-97392ea2-6e9f-44a5-8ed9-30c1bff7e482 req-3ae9d3fe-a3d6-4668-8642-4c88a900ca8e service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:15.192803 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-5686ac98-793c-4aeb-8bd0-9f3adfb1bbe3 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:15.205067 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-5686ac98-793c-4aeb-8bd0-9f3adfb1bbe3 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6" status: 200 len: 1608 microversion: 2.1 time: 0.285064 May 26 15:19:15.211148 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-97392ea2-6e9f-44a5-8ed9-30c1bff7e482 req-3ae9d3fe-a3d6-4668-8642-4c88a900ca8e service nova] Creating event network-vif-deleted:5907d8a5-d1b3-410e-9e64-143578f4b9e5 for instance 183130d4-7caf-4ba9-a0d1-69e8187f36c6 on hv-cinder-84301 May 26 15:19:15.218049 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 446/861] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:19:14 2022] GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6 => generated 1608 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:19:15.221347 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-97392ea2-6e9f-44a5-8ed9-30c1bff7e482 req-3ae9d3fe-a3d6-4668-8642-4c88a900ca8e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073309 May 26 15:19:15.223020 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 416/862] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:19:15.706648 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-6b048311-ce8a-4c9c-acdc-e94c1ba830d9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:15.707473 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-6b048311-ce8a-4c9c-acdc-e94c1ba830d9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:15.714042 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6b048311-ce8a-4c9c-acdc-e94c1ba830d9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:15.714618 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6b048311-ce8a-4c9c-acdc-e94c1ba830d9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:15.715532 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6b048311-ce8a-4c9c-acdc-e94c1ba830d9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:15.719318 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6b048311-ce8a-4c9c-acdc-e94c1ba830d9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:15.870403 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-6b048311-ce8a-4c9c-acdc-e94c1ba830d9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:15.881757 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-6b048311-ce8a-4c9c-acdc-e94c1ba830d9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:15.884057 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-6b048311-ce8a-4c9c-acdc-e94c1ba830d9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:15.885831 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-6b048311-ce8a-4c9c-acdc-e94c1ba830d9 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1732 microversion: 2.20 time: 0.184475 May 26 15:19:15.886578 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 447/863] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:19:15 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1732 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:19:16.225459 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-13252914-0435-4602-bc4c-9881410369bb tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:16.226223 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-13252914-0435-4602-bc4c-9881410369bb tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:16.233669 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-13252914-0435-4602-bc4c-9881410369bb tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:16.233976 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-13252914-0435-4602-bc4c-9881410369bb tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:16.234765 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-13252914-0435-4602-bc4c-9881410369bb tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:16.235251 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-13252914-0435-4602-bc4c-9881410369bb tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:16.308931 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-13252914-0435-4602-bc4c-9881410369bb tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:16.317769 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-13252914-0435-4602-bc4c-9881410369bb tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6" status: 200 len: 1323 microversion: 2.1 time: 0.097255 May 26 15:19:16.318586 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 417/864] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:19:16 2022] GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6 => generated 1323 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:19:16.905853 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-656b026c-f0e3-4fa4-bcec-67639166d093 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:16.906550 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-656b026c-f0e3-4fa4-bcec-67639166d093 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:16.914519 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-656b026c-f0e3-4fa4-bcec-67639166d093 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:16.914970 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-656b026c-f0e3-4fa4-bcec-67639166d093 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:16.915782 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-656b026c-f0e3-4fa4-bcec-67639166d093 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:16.916223 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-656b026c-f0e3-4fa4-bcec-67639166d093 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:17.051738 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-656b026c-f0e3-4fa4-bcec-67639166d093 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:17.060536 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-656b026c-f0e3-4fa4-bcec-67639166d093 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:17.062026 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-656b026c-f0e3-4fa4-bcec-67639166d093 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:17.063250 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-656b026c-f0e3-4fa4-bcec-67639166d093 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1732 microversion: 2.20 time: 0.161716 May 26 15:19:17.063854 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 448/865] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:19:16 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:19:17.336856 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-33688122-0540-4118-8c50-9e6655e455b6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:17.337451 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-33688122-0540-4118-8c50-9e6655e455b6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:17.344499 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-33688122-0540-4118-8c50-9e6655e455b6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:17.344875 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-33688122-0540-4118-8c50-9e6655e455b6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:17.346765 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-33688122-0540-4118-8c50-9e6655e455b6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:17.347259 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-33688122-0540-4118-8c50-9e6655e455b6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:17.414311 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-33688122-0540-4118-8c50-9e6655e455b6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:17.422163 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-33688122-0540-4118-8c50-9e6655e455b6 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6" status: 200 len: 1323 microversion: 2.1 time: 0.089481 May 26 15:19:17.422955 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 418/866] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:19:17 2022] GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6 => generated 1323 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:19:18.082455 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-62fa03ce-c1a0-4772-93cd-3864fd36f8eb tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:18.083061 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-62fa03ce-c1a0-4772-93cd-3864fd36f8eb tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:18.090911 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-62fa03ce-c1a0-4772-93cd-3864fd36f8eb tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:18.091422 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-62fa03ce-c1a0-4772-93cd-3864fd36f8eb tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:18.092212 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-62fa03ce-c1a0-4772-93cd-3864fd36f8eb tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:18.092652 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-62fa03ce-c1a0-4772-93cd-3864fd36f8eb tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:18.439287 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-3841e7a3-053b-4a2d-9b02-3e655ba9dc96 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:18.440028 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-3841e7a3-053b-4a2d-9b02-3e655ba9dc96 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:18.447300 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3841e7a3-053b-4a2d-9b02-3e655ba9dc96 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:18.447841 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3841e7a3-053b-4a2d-9b02-3e655ba9dc96 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:18.448694 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3841e7a3-053b-4a2d-9b02-3e655ba9dc96 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:18.449200 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3841e7a3-053b-4a2d-9b02-3e655ba9dc96 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:18.530816 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-3841e7a3-053b-4a2d-9b02-3e655ba9dc96 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:18.533779 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-62fa03ce-c1a0-4772-93cd-3864fd36f8eb tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:18.540336 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-3841e7a3-053b-4a2d-9b02-3e655ba9dc96 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6" status: 200 len: 1323 microversion: 2.1 time: 0.104853 May 26 15:19:18.540922 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 419/867] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:19:18 2022] GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6 => generated 1323 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:19:18.542572 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-62fa03ce-c1a0-4772-93cd-3864fd36f8eb tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:18.544089 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-62fa03ce-c1a0-4772-93cd-3864fd36f8eb tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:18.545261 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-62fa03ce-c1a0-4772-93cd-3864fd36f8eb tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1732 microversion: 2.20 time: 0.466706 May 26 15:19:18.545802 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 449/868] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:19:18 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1732 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:19:19.557868 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-be5ef259-3d05-4479-a01e-1a9fdb0bb5cd tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:19.558609 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-be5ef259-3d05-4479-a01e-1a9fdb0bb5cd tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:19.565427 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-34b1af13-9ed3-45cf-bec0-b9ef58020530 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:19.565874 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-be5ef259-3d05-4479-a01e-1a9fdb0bb5cd tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:19.566042 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-34b1af13-9ed3-45cf-bec0-b9ef58020530 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:19.566317 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-be5ef259-3d05-4479-a01e-1a9fdb0bb5cd tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:19.567101 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-be5ef259-3d05-4479-a01e-1a9fdb0bb5cd tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:19.567676 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-be5ef259-3d05-4479-a01e-1a9fdb0bb5cd tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:19.572929 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-34b1af13-9ed3-45cf-bec0-b9ef58020530 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:19.573377 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-34b1af13-9ed3-45cf-bec0-b9ef58020530 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:19.574196 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-34b1af13-9ed3-45cf-bec0-b9ef58020530 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:19.574635 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-34b1af13-9ed3-45cf-bec0-b9ef58020530 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:19.661253 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-be5ef259-3d05-4479-a01e-1a9fdb0bb5cd tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:19.670051 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-be5ef259-3d05-4479-a01e-1a9fdb0bb5cd tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6" status: 200 len: 1323 microversion: 2.1 time: 0.115910 May 26 15:19:19.670849 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 420/869] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:19:19 2022] GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6 => generated 1323 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:19:19.819247 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-34b1af13-9ed3-45cf-bec0-b9ef58020530 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:19.827854 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-34b1af13-9ed3-45cf-bec0-b9ef58020530 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:19.829586 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-34b1af13-9ed3-45cf-bec0-b9ef58020530 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:19.830805 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-34b1af13-9ed3-45cf-bec0-b9ef58020530 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1732 microversion: 2.20 time: 0.270008 May 26 15:19:19.831401 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 450/870] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:19:19 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1732 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:19:20.687367 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d7fdf2e8-8996-49fb-8b60-7399dc0b71a5 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:20.687998 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-d7fdf2e8-8996-49fb-8b60-7399dc0b71a5 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:20.696357 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d7fdf2e8-8996-49fb-8b60-7399dc0b71a5 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:20.696802 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d7fdf2e8-8996-49fb-8b60-7399dc0b71a5 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:20.697567 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d7fdf2e8-8996-49fb-8b60-7399dc0b71a5 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:20.698006 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d7fdf2e8-8996-49fb-8b60-7399dc0b71a5 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:20.764352 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d7fdf2e8-8996-49fb-8b60-7399dc0b71a5 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:20.772929 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-d7fdf2e8-8996-49fb-8b60-7399dc0b71a5 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6" status: 200 len: 1323 microversion: 2.1 time: 0.089435 May 26 15:19:20.774135 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 421/871] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:19:20 2022] GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6 => generated 1323 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:19:20.850090 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-fd106e01-1bc7-4e37-800a-fede60aa5cd6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:20.850685 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-fd106e01-1bc7-4e37-800a-fede60aa5cd6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:20.857192 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fd106e01-1bc7-4e37-800a-fede60aa5cd6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:20.857641 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fd106e01-1bc7-4e37-800a-fede60aa5cd6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:20.858412 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fd106e01-1bc7-4e37-800a-fede60aa5cd6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:20.858842 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fd106e01-1bc7-4e37-800a-fede60aa5cd6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:21.013051 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-fd106e01-1bc7-4e37-800a-fede60aa5cd6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:21.021922 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-fd106e01-1bc7-4e37-800a-fede60aa5cd6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:21.025120 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-fd106e01-1bc7-4e37-800a-fede60aa5cd6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:21.026819 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-fd106e01-1bc7-4e37-800a-fede60aa5cd6 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1732 microversion: 2.20 time: 0.180562 May 26 15:19:21.031458 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 451/872] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:19:20 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1732 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:19:21.790029 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-4e69704e-fc1d-42f0-862b-e5a8eff46996 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:21.790670 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-4e69704e-fc1d-42f0-862b-e5a8eff46996 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:21.798083 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4e69704e-fc1d-42f0-862b-e5a8eff46996 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:21.798539 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4e69704e-fc1d-42f0-862b-e5a8eff46996 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:21.799345 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4e69704e-fc1d-42f0-862b-e5a8eff46996 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:21.799782 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4e69704e-fc1d-42f0-862b-e5a8eff46996 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:21.864375 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-4e69704e-fc1d-42f0-862b-e5a8eff46996 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:21.873345 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-4e69704e-fc1d-42f0-862b-e5a8eff46996 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6" status: 200 len: 1323 microversion: 2.1 time: 0.087189 May 26 15:19:21.874019 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 422/873] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:19:21 2022] GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6 => generated 1323 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:19:22.047036 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-e2264792-40a1-4806-a96b-fab769a8e1a2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:22.048316 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-e2264792-40a1-4806-a96b-fab769a8e1a2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:22.055561 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e2264792-40a1-4806-a96b-fab769a8e1a2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:22.056017 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e2264792-40a1-4806-a96b-fab769a8e1a2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:22.056807 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e2264792-40a1-4806-a96b-fab769a8e1a2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:22.057248 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e2264792-40a1-4806-a96b-fab769a8e1a2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:22.198878 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-e2264792-40a1-4806-a96b-fab769a8e1a2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:22.210800 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-e2264792-40a1-4806-a96b-fab769a8e1a2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:22.212644 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-e2264792-40a1-4806-a96b-fab769a8e1a2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:22.214496 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-e2264792-40a1-4806-a96b-fab769a8e1a2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1732 microversion: 2.20 time: 0.170817 May 26 15:19:22.215071 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 452/874] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:19:22 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:19:22.893918 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-66975255-59a5-4d62-bc6f-2e625689e629 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:22.894601 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-66975255-59a5-4d62-bc6f-2e625689e629 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:22.901070 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-66975255-59a5-4d62-bc6f-2e625689e629 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:22.901514 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-66975255-59a5-4d62-bc6f-2e625689e629 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:22.902290 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-66975255-59a5-4d62-bc6f-2e625689e629 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:22.903016 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-66975255-59a5-4d62-bc6f-2e625689e629 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:22.971770 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-66975255-59a5-4d62-bc6f-2e625689e629 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:22.980316 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-66975255-59a5-4d62-bc6f-2e625689e629 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6" status: 200 len: 1323 microversion: 2.1 time: 0.093957 May 26 15:19:22.991146 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 423/875] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:19:22 2022] GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6 => generated 1323 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:19:23.234240 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-1e7df302-3608-422c-a091-0f3b8951c1d1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:23.234968 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-1e7df302-3608-422c-a091-0f3b8951c1d1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:23.242885 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1e7df302-3608-422c-a091-0f3b8951c1d1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:23.243380 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1e7df302-3608-422c-a091-0f3b8951c1d1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:23.244158 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1e7df302-3608-422c-a091-0f3b8951c1d1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:23.244590 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1e7df302-3608-422c-a091-0f3b8951c1d1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:23.392988 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-1e7df302-3608-422c-a091-0f3b8951c1d1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:23.401431 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-1e7df302-3608-422c-a091-0f3b8951c1d1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:23.402934 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-1e7df302-3608-422c-a091-0f3b8951c1d1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:23.404141 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-1e7df302-3608-422c-a091-0f3b8951c1d1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1732 microversion: 2.20 time: 0.174270 May 26 15:19:23.404694 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 453/876] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:19:23 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:19:23.999387 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-169ac756-0f25-4db1-be39-8471121451a5 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:24.000118 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-169ac756-0f25-4db1-be39-8471121451a5 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:24.008106 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-169ac756-0f25-4db1-be39-8471121451a5 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:24.008560 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-169ac756-0f25-4db1-be39-8471121451a5 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:24.009339 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-169ac756-0f25-4db1-be39-8471121451a5 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:24.009772 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-169ac756-0f25-4db1-be39-8471121451a5 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:24.077576 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-169ac756-0f25-4db1-be39-8471121451a5 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:24.091347 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-169ac756-0f25-4db1-be39-8471121451a5 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6" status: 200 len: 1323 microversion: 2.1 time: 0.095895 May 26 15:19:24.092192 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 424/877] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:19:23 2022] GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6 => generated 1323 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:19:24.424502 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-228622b5-c48a-455e-add7-27bb88e1732d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:24.425078 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-228622b5-c48a-455e-add7-27bb88e1732d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:24.431813 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-228622b5-c48a-455e-add7-27bb88e1732d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:24.432268 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-228622b5-c48a-455e-add7-27bb88e1732d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:24.433043 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-228622b5-c48a-455e-add7-27bb88e1732d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:24.433645 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-228622b5-c48a-455e-add7-27bb88e1732d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:24.570784 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-228622b5-c48a-455e-add7-27bb88e1732d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:24.579023 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-228622b5-c48a-455e-add7-27bb88e1732d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:24.580933 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-228622b5-c48a-455e-add7-27bb88e1732d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:24.582107 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-228622b5-c48a-455e-add7-27bb88e1732d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1732 microversion: 2.20 time: 0.162626 May 26 15:19:24.582663 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 454/878] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:19:24 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:19:25.108669 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-28197cb7-3ad7-4f49-add3-ec3034dccb4c tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:25.109273 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-28197cb7-3ad7-4f49-add3-ec3034dccb4c tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:25.116959 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-28197cb7-3ad7-4f49-add3-ec3034dccb4c tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:25.117402 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-28197cb7-3ad7-4f49-add3-ec3034dccb4c tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:25.118165 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-28197cb7-3ad7-4f49-add3-ec3034dccb4c tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:25.118597 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-28197cb7-3ad7-4f49-add3-ec3034dccb4c tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:25.136544 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=93,nova_cell1:UPDATE=4 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:19:25.188468 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-28197cb7-3ad7-4f49-add3-ec3034dccb4c tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:25.196355 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-28197cb7-3ad7-4f49-add3-ec3034dccb4c tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6" status: 200 len: 1323 microversion: 2.1 time: 0.091652 May 26 15:19:25.196933 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 425/879] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:19:25 2022] GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6 => generated 1323 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:19:25.601071 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-092882fb-8e82-4e10-bd3b-e059580537f0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:25.601683 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-092882fb-8e82-4e10-bd3b-e059580537f0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:25.608360 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-092882fb-8e82-4e10-bd3b-e059580537f0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:25.608809 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-092882fb-8e82-4e10-bd3b-e059580537f0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:25.609575 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-092882fb-8e82-4e10-bd3b-e059580537f0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:25.610013 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-092882fb-8e82-4e10-bd3b-e059580537f0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:25.738966 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-092882fb-8e82-4e10-bd3b-e059580537f0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:25.746837 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-092882fb-8e82-4e10-bd3b-e059580537f0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:25.748354 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-092882fb-8e82-4e10-bd3b-e059580537f0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:25.749503 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-092882fb-8e82-4e10-bd3b-e059580537f0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1732 microversion: 2.20 time: 0.152406 May 26 15:19:25.750063 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 455/880] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:19:25 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:19:26.213487 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-aff1f895-7432-4af5-b573-94caeb78a2a4 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:26.214179 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-aff1f895-7432-4af5-b573-94caeb78a2a4 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:26.220716 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-aff1f895-7432-4af5-b573-94caeb78a2a4 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:26.221157 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-aff1f895-7432-4af5-b573-94caeb78a2a4 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:26.221922 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-aff1f895-7432-4af5-b573-94caeb78a2a4 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:26.222354 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-aff1f895-7432-4af5-b573-94caeb78a2a4 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:26.287875 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-aff1f895-7432-4af5-b573-94caeb78a2a4 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:26.295295 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-aff1f895-7432-4af5-b573-94caeb78a2a4 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6" status: 200 len: 1323 microversion: 2.1 time: 0.085671 May 26 15:19:26.295826 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 426/881] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:19:26 2022] GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6 => generated 1323 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:19:26.770125 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-7cb5d9ee-e1af-4e30-8627-cbbe7560ff02 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:26.770728 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-7cb5d9ee-e1af-4e30-8627-cbbe7560ff02 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:26.777120 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7cb5d9ee-e1af-4e30-8627-cbbe7560ff02 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:26.777558 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7cb5d9ee-e1af-4e30-8627-cbbe7560ff02 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:26.778307 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7cb5d9ee-e1af-4e30-8627-cbbe7560ff02 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:26.778739 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7cb5d9ee-e1af-4e30-8627-cbbe7560ff02 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:26.912868 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-7cb5d9ee-e1af-4e30-8627-cbbe7560ff02 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:26.920731 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-7cb5d9ee-e1af-4e30-8627-cbbe7560ff02 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:26.922206 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-7cb5d9ee-e1af-4e30-8627-cbbe7560ff02 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:26.923862 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-7cb5d9ee-e1af-4e30-8627-cbbe7560ff02 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1732 microversion: 2.20 time: 0.158422 May 26 15:19:26.924411 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 456/882] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:19:26 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:19:27.312988 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-879300bc-0544-49a8-acde-5f9f007f6aa0 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:27.314054 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-879300bc-0544-49a8-acde-5f9f007f6aa0 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:27.321548 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-879300bc-0544-49a8-acde-5f9f007f6aa0 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:27.321996 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-879300bc-0544-49a8-acde-5f9f007f6aa0 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:27.322771 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-879300bc-0544-49a8-acde-5f9f007f6aa0 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:27.323236 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-879300bc-0544-49a8-acde-5f9f007f6aa0 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:27.386165 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-879300bc-0544-49a8-acde-5f9f007f6aa0 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:27.394874 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-879300bc-0544-49a8-acde-5f9f007f6aa0 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6" status: 200 len: 1323 microversion: 2.1 time: 0.085855 May 26 15:19:27.395488 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 427/883] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:19:27 2022] GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6 => generated 1323 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:19:27.941780 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-b88cc542-7a50-4584-9e84-217936177de0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:27.942393 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-b88cc542-7a50-4584-9e84-217936177de0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:27.948820 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b88cc542-7a50-4584-9e84-217936177de0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:27.949271 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b88cc542-7a50-4584-9e84-217936177de0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:27.950154 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b88cc542-7a50-4584-9e84-217936177de0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:27.950594 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b88cc542-7a50-4584-9e84-217936177de0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:28.083503 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-b88cc542-7a50-4584-9e84-217936177de0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:28.091478 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-b88cc542-7a50-4584-9e84-217936177de0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:28.092952 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-b88cc542-7a50-4584-9e84-217936177de0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:28.094136 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-b88cc542-7a50-4584-9e84-217936177de0 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1732 microversion: 2.20 time: 0.156252 May 26 15:19:28.095237 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 457/884] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:19:27 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:19:28.413640 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-12458368-e3ae-43cd-9b73-fc80831f30ae tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:28.414188 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-12458368-e3ae-43cd-9b73-fc80831f30ae tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:28.420060 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-12458368-e3ae-43cd-9b73-fc80831f30ae tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:28.420504 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-12458368-e3ae-43cd-9b73-fc80831f30ae tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:28.421269 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-12458368-e3ae-43cd-9b73-fc80831f30ae tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:28.421681 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-12458368-e3ae-43cd-9b73-fc80831f30ae tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:28.452684 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-12458368-e3ae-43cd-9b73-fc80831f30ae tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:28.453119 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-12458368-e3ae-43cd-9b73-fc80831f30ae tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:28.453559 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.objects.instance [None req-12458368-e3ae-43cd-9b73-fc80831f30ae tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lazy-loading 'fault' on Instance uuid 183130d4-7caf-4ba9-a0d1-69e8187f36c6 {{(pid=117798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:19:28.498866 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-12458368-e3ae-43cd-9b73-fc80831f30ae tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:28.506787 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-12458368-e3ae-43cd-9b73-fc80831f30ae tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6" status: 200 len: 1328 microversion: 2.1 time: 0.097609 May 26 15:19:28.507386 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 428/885] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:19:28 2022] GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6 => generated 1328 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:19:29.113059 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-a9a13579-ebf0-46f1-9e9a-c042c67b81ad tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:29.113673 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-a9a13579-ebf0-46f1-9e9a-c042c67b81ad tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:29.120246 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a9a13579-ebf0-46f1-9e9a-c042c67b81ad tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:29.120700 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a9a13579-ebf0-46f1-9e9a-c042c67b81ad tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:29.121485 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a9a13579-ebf0-46f1-9e9a-c042c67b81ad tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:29.121931 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a9a13579-ebf0-46f1-9e9a-c042c67b81ad tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:29.253379 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-a9a13579-ebf0-46f1-9e9a-c042c67b81ad tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:29.261105 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-a9a13579-ebf0-46f1-9e9a-c042c67b81ad tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:29.262580 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-a9a13579-ebf0-46f1-9e9a-c042c67b81ad tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:29.263750 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-a9a13579-ebf0-46f1-9e9a-c042c67b81ad tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1732 microversion: 2.20 time: 0.155715 May 26 15:19:29.264301 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 458/886] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:19:29 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:19:29.523920 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-7042ef4b-88a9-4013-8ea1-4e28e424a6a7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:29.524530 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-7042ef4b-88a9-4013-8ea1-4e28e424a6a7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:29.530977 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7042ef4b-88a9-4013-8ea1-4e28e424a6a7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:29.531459 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7042ef4b-88a9-4013-8ea1-4e28e424a6a7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:29.532776 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7042ef4b-88a9-4013-8ea1-4e28e424a6a7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:29.533296 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7042ef4b-88a9-4013-8ea1-4e28e424a6a7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:29.564038 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7042ef4b-88a9-4013-8ea1-4e28e424a6a7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:29.564484 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7042ef4b-88a9-4013-8ea1-4e28e424a6a7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:29.564935 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.objects.instance [None req-7042ef4b-88a9-4013-8ea1-4e28e424a6a7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lazy-loading 'fault' on Instance uuid 183130d4-7caf-4ba9-a0d1-69e8187f36c6 {{(pid=117798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:19:29.605847 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7042ef4b-88a9-4013-8ea1-4e28e424a6a7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:29.613976 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-7042ef4b-88a9-4013-8ea1-4e28e424a6a7 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6" status: 200 len: 1328 microversion: 2.1 time: 0.093934 May 26 15:19:29.614543 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 429/887] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:19:29 2022] GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6 => generated 1328 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:19:30.281818 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-64881a42-ac69-4038-a237-099648f03c02 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:30.282527 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-64881a42-ac69-4038-a237-099648f03c02 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:30.288961 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-64881a42-ac69-4038-a237-099648f03c02 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:30.289404 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-64881a42-ac69-4038-a237-099648f03c02 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:30.290164 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-64881a42-ac69-4038-a237-099648f03c02 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:30.290594 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-64881a42-ac69-4038-a237-099648f03c02 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:30.429333 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-64881a42-ac69-4038-a237-099648f03c02 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:30.437700 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-64881a42-ac69-4038-a237-099648f03c02 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:30.439810 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-64881a42-ac69-4038-a237-099648f03c02 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:30.440973 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-64881a42-ac69-4038-a237-099648f03c02 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1732 microversion: 2.20 time: 0.163124 May 26 15:19:30.441540 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 459/888] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:19:30 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:19:30.630170 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f1d05fad-ec4b-4b47-b2f0-41b6f7e33064 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:30.630702 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f1d05fad-ec4b-4b47-b2f0-41b6f7e33064 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:30.636879 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f1d05fad-ec4b-4b47-b2f0-41b6f7e33064 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:30.637320 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f1d05fad-ec4b-4b47-b2f0-41b6f7e33064 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:30.638075 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f1d05fad-ec4b-4b47-b2f0-41b6f7e33064 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:30.638507 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f1d05fad-ec4b-4b47-b2f0-41b6f7e33064 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:30.672285 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f1d05fad-ec4b-4b47-b2f0-41b6f7e33064 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:30.672728 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f1d05fad-ec4b-4b47-b2f0-41b6f7e33064 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:30.673323 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.objects.instance [None req-f1d05fad-ec4b-4b47-b2f0-41b6f7e33064 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lazy-loading 'fault' on Instance uuid 183130d4-7caf-4ba9-a0d1-69e8187f36c6 {{(pid=117798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:19:30.723954 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f1d05fad-ec4b-4b47-b2f0-41b6f7e33064 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a671e0538ca45bbb44c298f1aa13a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ea8fbf32d748a8ad70996a9fa12843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:30.732683 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f1d05fad-ec4b-4b47-b2f0-41b6f7e33064 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6" status: 200 len: 1328 microversion: 2.1 time: 0.106770 May 26 15:19:30.733495 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 430/889] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:19:30 2022] GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6 => generated 1328 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:19:31.459686 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-240de35e-c901-4efd-9391-30ae7e72f7a1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:31.460214 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-240de35e-c901-4efd-9391-30ae7e72f7a1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:31.466925 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-240de35e-c901-4efd-9391-30ae7e72f7a1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:31.467456 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-240de35e-c901-4efd-9391-30ae7e72f7a1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:31.468246 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-240de35e-c901-4efd-9391-30ae7e72f7a1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:31.468708 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-240de35e-c901-4efd-9391-30ae7e72f7a1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:31.597326 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-240de35e-c901-4efd-9391-30ae7e72f7a1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:31.605131 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-240de35e-c901-4efd-9391-30ae7e72f7a1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:31.606615 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-240de35e-c901-4efd-9391-30ae7e72f7a1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:31.607797 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-240de35e-c901-4efd-9391-30ae7e72f7a1 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1732 microversion: 2.20 time: 0.152295 May 26 15:19:31.608348 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 460/890] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:19:31 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:19:31.749928 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-fad7c4f0-51af-4806-8ccf-2b6ba1807a73 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:31.750574 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-fad7c4f0-51af-4806-8ccf-2b6ba1807a73 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:31.757295 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fad7c4f0-51af-4806-8ccf-2b6ba1807a73 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:31.757750 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fad7c4f0-51af-4806-8ccf-2b6ba1807a73 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:31.758518 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fad7c4f0-51af-4806-8ccf-2b6ba1807a73 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:31.758956 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fad7c4f0-51af-4806-8ccf-2b6ba1807a73 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:31.772679 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-fad7c4f0-51af-4806-8ccf-2b6ba1807a73 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] HTTP exception thrown: Instance 183130d4-7caf-4ba9-a0d1-69e8187f36c6 could not be found. May 26 15:19:31.774334 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-fad7c4f0-51af-4806-8ccf-2b6ba1807a73 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Request method failure captured: May 26 15:19:31.774334 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: request: GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6 HTTP/1.1 May 26 15:19:31.774334 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept: application/json May 26 15:19:31.774334 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity May 26 15:19:31.774334 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Connection: close May 26 15:19:31.774334 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Length: 0 May 26 15:19:31.774334 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Type: application/json May 26 15:19:31.774334 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Host: 10.222.0.45 May 26 15:19:31.774334 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None May 26 15:19:31.774334 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 May 26 15:19:31.774334 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABij5gIExbyS76VlcxLoqQooFhb7Z8eRLQ49lj5E236AgcYQzWvrYNTDh3LsojPKqzwLYn8AdzTWzvcg-Xtk4RL20gFH_DNeuLEw9AbD2-2qHE9Ym4k68qhVJTCSvw2cCH9uYlhvEZWTdjhBQi1_8UmyiZ--_0tYCoQ-qfmOmmP1LkmeF0 May 26 15:19:31.774334 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Id: None May 26 15:19:31.774334 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Name: None May 26 15:19:31.774334 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed May 26 15:19:31.774334 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True May 26 15:19:31.774334 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default May 26 15:19:31.774334 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default May 26 15:19:31.774334 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Id: 85ea8fbf32d748a8ad70996a9fa12843 May 26 15:19:31.774334 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-AttachVolumeTestJSON-336307212 May 26 15:19:31.774334 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Role: reader,member May 26 15:19:31.774334 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Roles: reader,member May 26 15:19:31.775985 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/85ea8fbf32d748a8ad70996a9fa12843"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/85ea8fbf32d748a8ad70996a9fa12843"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/85ea8fbf32d748a8ad70996a9fa12843"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_85ea8fbf32d748a8ad70996a9fa12843"}]}] May 26 15:19:31.775985 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-AttachVolumeTestJSON-336307212 May 26 15:19:31.775985 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Id: 85ea8fbf32d748a8ad70996a9fa12843 May 26 15:19:31.775985 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-AttachVolumeTestJSON-336307212 May 26 15:19:31.775985 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User: tempest-AttachVolumeTestJSON-336307212-project May 26 15:19:31.775985 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default May 26 15:19:31.775985 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default May 26 15:19:31.775985 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Id: 9a671e0538ca45bbb44c298f1aa13a37 May 26 15:19:31.775985 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-AttachVolumeTestJSON-336307212-project May 26 15:19:31.775985 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: method: > May 26 15:19:31.775985 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: exception: Instance 183130d4-7caf-4ba9-a0d1-69e8187f36c6 could not be found. May 26 15:19:31.775985 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: action_args: {'id': '183130d4-7caf-4ba9-a0d1-69e8187f36c6'} May 26 15:19:31.776961 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:19:31.776961 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:19:31.776961 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:19:31.776961 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:19:31.776961 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:19:31.776961 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:19:31.776961 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:19:31.776961 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:19:31.776961 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:19:31.776961 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:19:31.776961 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 183130d4-7caf-4ba9-a0d1-69e8187f36c6 could not be found. May 26 15:19:31.776961 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:19:31.776961 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:19:31.776961 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:19:31.776961 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:19:31.776961 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:19:31.776961 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:19:31.776961 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:19:31.776961 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:19:31.776961 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:19:31.778535 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:19:31.778535 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:19:31.778535 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:19:31.778535 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:19:31.778535 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:19:31.778535 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:19:31.778535 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:19:31.778535 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 183130d4-7caf-4ba9-a0d1-69e8187f36c6 could not be found. May 26 15:19:31.778535 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:19:31.778535 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:19:31.778535 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:19:31.778535 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:19:31.778535 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:19:31.778535 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:19:31.778535 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:19:31.778535 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:19:31.778535 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 183130d4-7caf-4ba9-a0d1-69e8187f36c6 could not be found. May 26 15:19:31.778535 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:19:31.780093 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-fad7c4f0-51af-4806-8ccf-2b6ba1807a73 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Returning 404 to user: Instance 183130d4-7caf-4ba9-a0d1-69e8187f36c6 could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:19:31.780093 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-fad7c4f0-51af-4806-8ccf-2b6ba1807a73 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6" status: 404 len: 111 microversion: 2.1 time: 0.029916 May 26 15:19:31.780093 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 431/891] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:19:31 2022] GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:19:31.785584 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-5fedc7cc-1515-4c0f-93a8-bef917a14bce tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '.version_select at 0x7ffb5d6a4dc0>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:31.791423 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_api:SELECT=58 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:19:31.804742 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-5fedc7cc-1515-4c0f-93a8-bef917a14bce tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1746935605" status: 202 len: 0 microversion: 2.1 time: 0.023758 May 26 15:19:31.805309 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 461/892] 10.222.0.45 () {58 vars in 1220 bytes} [Thu May 26 15:19:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1746935605 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 15:19:32.626006 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1990dc27-7a19-4db7-8f0b-a0ed105daa30 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:32.626687 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1990dc27-7a19-4db7-8f0b-a0ed105daa30 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:32.632746 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1990dc27-7a19-4db7-8f0b-a0ed105daa30 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:32.633268 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1990dc27-7a19-4db7-8f0b-a0ed105daa30 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:32.634162 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1990dc27-7a19-4db7-8f0b-a0ed105daa30 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:32.634598 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1990dc27-7a19-4db7-8f0b-a0ed105daa30 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:32.660391 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-b54b1315-f489-4846-be44-ddd1303c5737 req-4d63bc65-54b5-4288-9592-75d73b65d5ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d97e6323-aeef-4755-9bc5-93ae5140640b", "name": "network-vif-plugged", "status": "completed", "tag": "88cc91ef-0c85-4971-928d-0eb2739f6222"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:19:32.670043 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-b54b1315-f489-4846-be44-ddd1303c5737 req-4d63bc65-54b5-4288-9592-75d73b65d5ca service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:32.670509 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-b54b1315-f489-4846-be44-ddd1303c5737 req-4d63bc65-54b5-4288-9592-75d73b65d5ca service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:32.684162 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-b54b1315-f489-4846-be44-ddd1303c5737 req-4d63bc65-54b5-4288-9592-75d73b65d5ca service nova] Creating event network-vif-plugged:88cc91ef-0c85-4971-928d-0eb2739f6222 for instance d97e6323-aeef-4755-9bc5-93ae5140640b on hv-cinder-84301 May 26 15:19:32.690130 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-b54b1315-f489-4846-be44-ddd1303c5737 req-4d63bc65-54b5-4288-9592-75d73b65d5ca service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034678 May 26 15:19:32.690747 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 462/893] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:19:32.781772 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1990dc27-7a19-4db7-8f0b-a0ed105daa30 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:32.792137 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1990dc27-7a19-4db7-8f0b-a0ed105daa30 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:32.793924 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1990dc27-7a19-4db7-8f0b-a0ed105daa30 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:32.795419 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1990dc27-7a19-4db7-8f0b-a0ed105daa30 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1732 microversion: 2.20 time: 0.173471 May 26 15:19:32.796770 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 432/894] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:19:32 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:19:33.816770 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-e4e7579c-8aed-4f08-a8e0-e7e1ccb73dd2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:33.817370 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-e4e7579c-8aed-4f08-a8e0-e7e1ccb73dd2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:33.823602 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e4e7579c-8aed-4f08-a8e0-e7e1ccb73dd2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:33.824058 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e4e7579c-8aed-4f08-a8e0-e7e1ccb73dd2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:33.824808 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e4e7579c-8aed-4f08-a8e0-e7e1ccb73dd2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:33.825245 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e4e7579c-8aed-4f08-a8e0-e7e1ccb73dd2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:33.962554 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-e4e7579c-8aed-4f08-a8e0-e7e1ccb73dd2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:33.971206 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-e4e7579c-8aed-4f08-a8e0-e7e1ccb73dd2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:33.972766 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-e4e7579c-8aed-4f08-a8e0-e7e1ccb73dd2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:33.973928 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-e4e7579c-8aed-4f08-a8e0-e7e1ccb73dd2 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1732 microversion: 2.20 time: 0.162633 May 26 15:19:33.974492 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 463/895] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:19:33 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:19:34.687418 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f2004361-6cfd-40ac-9081-a32ca400bca5 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:34.687949 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f2004361-6cfd-40ac-9081-a32ca400bca5 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:34.690645 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:19:34.697264 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f2004361-6cfd-40ac-9081-a32ca400bca5 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:34.698020 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f2004361-6cfd-40ac-9081-a32ca400bca5 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:34.699073 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f2004361-6cfd-40ac-9081-a32ca400bca5 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:34.699542 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f2004361-6cfd-40ac-9081-a32ca400bca5 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:34.717955 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-f2004361-6cfd-40ac-9081-a32ca400bca5 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] HTTP exception thrown: Instance 183130d4-7caf-4ba9-a0d1-69e8187f36c6 could not be found. May 26 15:19:34.720173 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f2004361-6cfd-40ac-9081-a32ca400bca5 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Request method failure captured: May 26 15:19:34.720173 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: request: DELETE /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6 HTTP/1.1 May 26 15:19:34.720173 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept: application/json May 26 15:19:34.720173 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity May 26 15:19:34.720173 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Connection: close May 26 15:19:34.720173 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Length: 0 May 26 15:19:34.720173 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Type: application/json May 26 15:19:34.720173 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Host: 10.222.0.45 May 26 15:19:34.720173 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None May 26 15:19:34.720173 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 May 26 15:19:34.720173 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABij5gIExbyS76VlcxLoqQooFhb7Z8eRLQ49lj5E236AgcYQzWvrYNTDh3LsojPKqzwLYn8AdzTWzvcg-Xtk4RL20gFH_DNeuLEw9AbD2-2qHE9Ym4k68qhVJTCSvw2cCH9uYlhvEZWTdjhBQi1_8UmyiZ--_0tYCoQ-qfmOmmP1LkmeF0 May 26 15:19:34.720173 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Id: None May 26 15:19:34.720173 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Name: None May 26 15:19:34.720173 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed May 26 15:19:34.720173 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True May 26 15:19:34.720173 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default May 26 15:19:34.720173 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default May 26 15:19:34.720173 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Id: 85ea8fbf32d748a8ad70996a9fa12843 May 26 15:19:34.720173 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-AttachVolumeTestJSON-336307212 May 26 15:19:34.720173 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Role: reader,member May 26 15:19:34.720173 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Roles: reader,member May 26 15:19:34.721714 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/85ea8fbf32d748a8ad70996a9fa12843"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/85ea8fbf32d748a8ad70996a9fa12843"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/85ea8fbf32d748a8ad70996a9fa12843"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_85ea8fbf32d748a8ad70996a9fa12843"}]}] May 26 15:19:34.721714 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-AttachVolumeTestJSON-336307212 May 26 15:19:34.721714 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Id: 85ea8fbf32d748a8ad70996a9fa12843 May 26 15:19:34.721714 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-AttachVolumeTestJSON-336307212 May 26 15:19:34.721714 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User: tempest-AttachVolumeTestJSON-336307212-project May 26 15:19:34.721714 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default May 26 15:19:34.721714 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default May 26 15:19:34.721714 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Id: 9a671e0538ca45bbb44c298f1aa13a37 May 26 15:19:34.721714 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-AttachVolumeTestJSON-336307212-project May 26 15:19:34.721714 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: method: > May 26 15:19:34.721714 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: exception: Instance 183130d4-7caf-4ba9-a0d1-69e8187f36c6 could not be found. May 26 15:19:34.721714 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: action_args: {'id': '183130d4-7caf-4ba9-a0d1-69e8187f36c6'} May 26 15:19:34.725530 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:19:34.725530 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:19:34.725530 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:19:34.725530 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:19:34.725530 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:19:34.725530 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:19:34.725530 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:19:34.725530 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:19:34.725530 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:19:34.725530 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:19:34.725530 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 183130d4-7caf-4ba9-a0d1-69e8187f36c6 could not be found. May 26 15:19:34.725530 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:19:34.725530 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:19:34.725530 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:19:34.725530 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:19:34.725530 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:19:34.725530 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:19:34.725530 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:19:34.725530 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:19:34.725530 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:19:34.726984 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:19:34.726984 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 15:19:34.726984 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 15:19:34.726984 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 15:19:34.726984 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 15:19:34.726984 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:19:34.726984 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:19:34.726984 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:19:34.726984 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:19:34.726984 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 183130d4-7caf-4ba9-a0d1-69e8187f36c6 could not be found. May 26 15:19:34.726984 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:19:34.726984 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:19:34.726984 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:19:34.726984 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:19:34.726984 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:19:34.726984 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:19:34.726984 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:19:34.726984 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:19:34.726984 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 183130d4-7caf-4ba9-a0d1-69e8187f36c6 could not be found. May 26 15:19:34.726984 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:19:34.728519 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f2004361-6cfd-40ac-9081-a32ca400bca5 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Returning 404 to user: Instance 183130d4-7caf-4ba9-a0d1-69e8187f36c6 could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:19:34.728519 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f2004361-6cfd-40ac-9081-a32ca400bca5 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "DELETE /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6" status: 404 len: 111 microversion: 2.1 time: 0.038420 May 26 15:19:34.728519 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 433/896] 10.222.0.45 () {58 vars in 1238 bytes} [Thu May 26 15:19:34 2022] DELETE /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:19:34.730597 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-c31c8bd7-cece-4703-8f7a-074c08518199 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:34.731239 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-c31c8bd7-cece-4703-8f7a-074c08518199 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 183130d4-7caf-4ba9-a0d1-69e8187f36c6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:34.739609 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c31c8bd7-cece-4703-8f7a-074c08518199 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:34.740149 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c31c8bd7-cece-4703-8f7a-074c08518199 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:34.740861 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c31c8bd7-cece-4703-8f7a-074c08518199 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:34.741344 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c31c8bd7-cece-4703-8f7a-074c08518199 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:34.744223 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=100 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:19:34.756018 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.wsgi [None req-c31c8bd7-cece-4703-8f7a-074c08518199 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] HTTP exception thrown: Instance 183130d4-7caf-4ba9-a0d1-69e8187f36c6 could not be found. May 26 15:19:34.757663 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-c31c8bd7-cece-4703-8f7a-074c08518199 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Request method failure captured: May 26 15:19:34.757663 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: request: GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6 HTTP/1.1 May 26 15:19:34.757663 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept: application/json May 26 15:19:34.757663 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept-Encoding: identity May 26 15:19:34.757663 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Connection: close May 26 15:19:34.757663 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Length: 0 May 26 15:19:34.757663 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Type: application/json May 26 15:19:34.757663 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Host: 10.222.0.45 May 26 15:19:34.757663 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Openstack-System-Scope: None May 26 15:19:34.757663 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: User-Agent: python-urllib3/1.26.9 May 26 15:19:34.757663 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Auth-Token: gAAAAABij5gIExbyS76VlcxLoqQooFhb7Z8eRLQ49lj5E236AgcYQzWvrYNTDh3LsojPKqzwLYn8AdzTWzvcg-Xtk4RL20gFH_DNeuLEw9AbD2-2qHE9Ym4k68qhVJTCSvw2cCH9uYlhvEZWTdjhBQi1_8UmyiZ--_0tYCoQ-qfmOmmP1LkmeF0 May 26 15:19:34.757663 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Id: None May 26 15:19:34.757663 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Name: None May 26 15:19:34.757663 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Identity-Status: Confirmed May 26 15:19:34.757663 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Is-Admin-Project: True May 26 15:19:34.757663 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Id: default May 26 15:19:34.757663 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Name: Default May 26 15:19:34.757663 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Id: 85ea8fbf32d748a8ad70996a9fa12843 May 26 15:19:34.757663 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Name: tempest-AttachVolumeTestJSON-336307212 May 26 15:19:34.757663 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Role: reader,member May 26 15:19:34.757663 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Roles: reader,member May 26 15:19:34.758967 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/85ea8fbf32d748a8ad70996a9fa12843"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/85ea8fbf32d748a8ad70996a9fa12843"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/85ea8fbf32d748a8ad70996a9fa12843"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_85ea8fbf32d748a8ad70996a9fa12843"}]}] May 26 15:19:34.758967 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant: tempest-AttachVolumeTestJSON-336307212 May 26 15:19:34.758967 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Id: 85ea8fbf32d748a8ad70996a9fa12843 May 26 15:19:34.758967 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Name: tempest-AttachVolumeTestJSON-336307212 May 26 15:19:34.758967 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User: tempest-AttachVolumeTestJSON-336307212-project May 26 15:19:34.758967 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Id: default May 26 15:19:34.758967 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Name: Default May 26 15:19:34.758967 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Id: 9a671e0538ca45bbb44c298f1aa13a37 May 26 15:19:34.758967 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Name: tempest-AttachVolumeTestJSON-336307212-project May 26 15:19:34.758967 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: method: > May 26 15:19:34.758967 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: exception: Instance 183130d4-7caf-4ba9-a0d1-69e8187f36c6 could not be found. May 26 15:19:34.758967 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: action_args: {'id': '183130d4-7caf-4ba9-a0d1-69e8187f36c6'} May 26 15:19:34.760079 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:19:34.760079 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:19:34.760079 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:19:34.760079 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:19:34.760079 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:19:34.760079 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:19:34.760079 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:19:34.760079 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:19:34.760079 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:19:34.760079 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:19:34.760079 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 183130d4-7caf-4ba9-a0d1-69e8187f36c6 could not be found. May 26 15:19:34.760079 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:19:34.760079 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:19:34.760079 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:19:34.760079 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:19:34.760079 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:19:34.760079 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:19:34.760079 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:19:34.760079 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:19:34.760079 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:19:34.761442 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:19:34.761442 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:19:34.761442 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:19:34.761442 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:19:34.761442 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:19:34.761442 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:19:34.761442 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:19:34.761442 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 183130d4-7caf-4ba9-a0d1-69e8187f36c6 could not be found. May 26 15:19:34.761442 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:19:34.761442 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:19:34.761442 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:19:34.761442 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:19:34.761442 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:19:34.761442 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:19:34.761442 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:19:34.761442 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:19:34.761442 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 183130d4-7caf-4ba9-a0d1-69e8187f36c6 could not be found. May 26 15:19:34.761442 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:19:34.762759 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-c31c8bd7-cece-4703-8f7a-074c08518199 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Returning 404 to user: Instance 183130d4-7caf-4ba9-a0d1-69e8187f36c6 could not be found. {{(pid=117799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:19:34.762759 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-c31c8bd7-cece-4703-8f7a-074c08518199 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6" status: 404 len: 111 microversion: 2.1 time: 0.032864 May 26 15:19:34.762759 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 464/897] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:19:34 2022] GET /compute/v2.1/servers/183130d4-7caf-4ba9-a0d1-69e8187f36c6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:19:34.992340 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b976f27a-14e4-4919-892c-ca0da9735d1b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:34.992967 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b976f27a-14e4-4919-892c-ca0da9735d1b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:34.998977 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b976f27a-14e4-4919-892c-ca0da9735d1b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:34.999440 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b976f27a-14e4-4919-892c-ca0da9735d1b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:35.000186 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b976f27a-14e4-4919-892c-ca0da9735d1b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:35.000619 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b976f27a-14e4-4919-892c-ca0da9735d1b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:35.153126 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b976f27a-14e4-4919-892c-ca0da9735d1b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:35.161344 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b976f27a-14e4-4919-892c-ca0da9735d1b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:35.162849 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b976f27a-14e4-4919-892c-ca0da9735d1b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:35.164061 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b976f27a-14e4-4919-892c-ca0da9735d1b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1732 microversion: 2.20 time: 0.175665 May 26 15:19:35.164627 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 434/898] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:19:34 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:19:35.905415 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-d6d49a64-9f7b-41e7-8020-c334bcd8f170 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:35.905892 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-d6d49a64-9f7b-41e7-8020-c334bcd8f170 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:35.913728 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d6d49a64-9f7b-41e7-8020-c334bcd8f170 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:35.914166 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d6d49a64-9f7b-41e7-8020-c334bcd8f170 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:35.914925 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d6d49a64-9f7b-41e7-8020-c334bcd8f170 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:35.915376 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d6d49a64-9f7b-41e7-8020-c334bcd8f170 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:35.929369 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.wsgi [None req-d6d49a64-9f7b-41e7-8020-c334bcd8f170 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] HTTP exception thrown: Instance 29d9c670-e34a-4363-9e60-745335a3ea6c could not be found. May 26 15:19:35.930953 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-d6d49a64-9f7b-41e7-8020-c334bcd8f170 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Request method failure captured: May 26 15:19:35.930953 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: request: DELETE /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c HTTP/1.1 May 26 15:19:35.930953 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept: application/json May 26 15:19:35.930953 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept-Encoding: identity May 26 15:19:35.930953 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Connection: close May 26 15:19:35.930953 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Length: 0 May 26 15:19:35.930953 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Type: application/json May 26 15:19:35.930953 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Host: 10.222.0.45 May 26 15:19:35.930953 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Openstack-System-Scope: None May 26 15:19:35.930953 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: User-Agent: python-urllib3/1.26.9 May 26 15:19:35.930953 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Auth-Token: gAAAAABij5gIExbyS76VlcxLoqQooFhb7Z8eRLQ49lj5E236AgcYQzWvrYNTDh3LsojPKqzwLYn8AdzTWzvcg-Xtk4RL20gFH_DNeuLEw9AbD2-2qHE9Ym4k68qhVJTCSvw2cCH9uYlhvEZWTdjhBQi1_8UmyiZ--_0tYCoQ-qfmOmmP1LkmeF0 May 26 15:19:35.930953 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Id: None May 26 15:19:35.930953 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Name: None May 26 15:19:35.930953 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Identity-Status: Confirmed May 26 15:19:35.930953 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Is-Admin-Project: True May 26 15:19:35.930953 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Id: default May 26 15:19:35.930953 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Name: Default May 26 15:19:35.930953 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Id: 85ea8fbf32d748a8ad70996a9fa12843 May 26 15:19:35.930953 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Name: tempest-AttachVolumeTestJSON-336307212 May 26 15:19:35.930953 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Role: reader,member May 26 15:19:35.930953 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Roles: reader,member May 26 15:19:35.932529 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/85ea8fbf32d748a8ad70996a9fa12843"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/85ea8fbf32d748a8ad70996a9fa12843"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/85ea8fbf32d748a8ad70996a9fa12843"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_85ea8fbf32d748a8ad70996a9fa12843"}]}] May 26 15:19:35.932529 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant: tempest-AttachVolumeTestJSON-336307212 May 26 15:19:35.932529 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Id: 85ea8fbf32d748a8ad70996a9fa12843 May 26 15:19:35.932529 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Name: tempest-AttachVolumeTestJSON-336307212 May 26 15:19:35.932529 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User: tempest-AttachVolumeTestJSON-336307212-project May 26 15:19:35.932529 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Id: default May 26 15:19:35.932529 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Name: Default May 26 15:19:35.932529 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Id: 9a671e0538ca45bbb44c298f1aa13a37 May 26 15:19:35.932529 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Name: tempest-AttachVolumeTestJSON-336307212-project May 26 15:19:35.932529 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: method: > May 26 15:19:35.932529 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: exception: Instance 29d9c670-e34a-4363-9e60-745335a3ea6c could not be found. May 26 15:19:35.932529 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: action_args: {'id': '29d9c670-e34a-4363-9e60-745335a3ea6c'} May 26 15:19:35.933338 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:19:35.933338 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:19:35.933338 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:19:35.933338 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:19:35.933338 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:19:35.933338 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:19:35.933338 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:19:35.933338 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:19:35.933338 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:19:35.933338 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:19:35.933338 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29d9c670-e34a-4363-9e60-745335a3ea6c could not be found. May 26 15:19:35.933338 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:19:35.933338 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:19:35.933338 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:19:35.933338 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:19:35.933338 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:19:35.933338 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:19:35.933338 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:19:35.933338 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:19:35.933338 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:19:35.934585 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:19:35.934585 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 15:19:35.934585 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 15:19:35.934585 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 15:19:35.934585 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 15:19:35.934585 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:19:35.934585 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:19:35.934585 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:19:35.934585 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:19:35.934585 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29d9c670-e34a-4363-9e60-745335a3ea6c could not be found. May 26 15:19:35.934585 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:19:35.934585 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:19:35.934585 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:19:35.934585 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:19:35.934585 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:19:35.934585 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:19:35.934585 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:19:35.934585 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:19:35.934585 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29d9c670-e34a-4363-9e60-745335a3ea6c could not be found. May 26 15:19:35.934585 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:19:35.935837 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-d6d49a64-9f7b-41e7-8020-c334bcd8f170 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Returning 404 to user: Instance 29d9c670-e34a-4363-9e60-745335a3ea6c could not be found. {{(pid=117799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:19:35.935837 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-d6d49a64-9f7b-41e7-8020-c334bcd8f170 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "DELETE /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 404 len: 111 microversion: 2.1 time: 0.030808 May 26 15:19:35.935837 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 465/899] 10.222.0.45 () {58 vars in 1238 bytes} [Thu May 26 15:19:35 2022] DELETE /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:19:35.940968 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a29d53db-2a26-4d4c-8256-4c5c9e3daab1 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:35.941580 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a29d53db-2a26-4d4c-8256-4c5c9e3daab1 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] [instance: 29d9c670-e34a-4363-9e60-745335a3ea6c] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:35.948064 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a29d53db-2a26-4d4c-8256-4c5c9e3daab1 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:35.948517 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a29d53db-2a26-4d4c-8256-4c5c9e3daab1 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:35.949288 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a29d53db-2a26-4d4c-8256-4c5c9e3daab1 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:35.949729 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a29d53db-2a26-4d4c-8256-4c5c9e3daab1 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:35.964019 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-a29d53db-2a26-4d4c-8256-4c5c9e3daab1 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] HTTP exception thrown: Instance 29d9c670-e34a-4363-9e60-745335a3ea6c could not be found. May 26 15:19:35.965540 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a29d53db-2a26-4d4c-8256-4c5c9e3daab1 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Request method failure captured: May 26 15:19:35.965540 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: request: GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c HTTP/1.1 May 26 15:19:35.965540 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept: application/json May 26 15:19:35.965540 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity May 26 15:19:35.965540 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Connection: close May 26 15:19:35.965540 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Length: 0 May 26 15:19:35.965540 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Type: application/json May 26 15:19:35.965540 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Host: 10.222.0.45 May 26 15:19:35.965540 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None May 26 15:19:35.965540 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 May 26 15:19:35.965540 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABij5gIExbyS76VlcxLoqQooFhb7Z8eRLQ49lj5E236AgcYQzWvrYNTDh3LsojPKqzwLYn8AdzTWzvcg-Xtk4RL20gFH_DNeuLEw9AbD2-2qHE9Ym4k68qhVJTCSvw2cCH9uYlhvEZWTdjhBQi1_8UmyiZ--_0tYCoQ-qfmOmmP1LkmeF0 May 26 15:19:35.965540 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Id: None May 26 15:19:35.965540 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Name: None May 26 15:19:35.965540 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed May 26 15:19:35.965540 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True May 26 15:19:35.965540 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default May 26 15:19:35.965540 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default May 26 15:19:35.965540 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Id: 85ea8fbf32d748a8ad70996a9fa12843 May 26 15:19:35.965540 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-AttachVolumeTestJSON-336307212 May 26 15:19:35.965540 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Role: reader,member May 26 15:19:35.965540 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Roles: reader,member May 26 15:19:35.966955 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/85ea8fbf32d748a8ad70996a9fa12843"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/85ea8fbf32d748a8ad70996a9fa12843"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/85ea8fbf32d748a8ad70996a9fa12843"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_85ea8fbf32d748a8ad70996a9fa12843"}]}] May 26 15:19:35.966955 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-AttachVolumeTestJSON-336307212 May 26 15:19:35.966955 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Id: 85ea8fbf32d748a8ad70996a9fa12843 May 26 15:19:35.966955 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-AttachVolumeTestJSON-336307212 May 26 15:19:35.966955 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User: tempest-AttachVolumeTestJSON-336307212-project May 26 15:19:35.966955 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default May 26 15:19:35.966955 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default May 26 15:19:35.966955 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Id: 9a671e0538ca45bbb44c298f1aa13a37 May 26 15:19:35.966955 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-AttachVolumeTestJSON-336307212-project May 26 15:19:35.966955 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: method: > May 26 15:19:35.966955 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: exception: Instance 29d9c670-e34a-4363-9e60-745335a3ea6c could not be found. May 26 15:19:35.966955 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: action_args: {'id': '29d9c670-e34a-4363-9e60-745335a3ea6c'} May 26 15:19:35.967890 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:19:35.967890 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:19:35.967890 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:19:35.967890 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:19:35.967890 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:19:35.967890 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:19:35.967890 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:19:35.967890 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:19:35.967890 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:19:35.967890 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:19:35.967890 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29d9c670-e34a-4363-9e60-745335a3ea6c could not be found. May 26 15:19:35.967890 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:19:35.967890 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:19:35.967890 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:19:35.967890 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:19:35.967890 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:19:35.967890 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:19:35.967890 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:19:35.967890 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:19:35.967890 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:19:35.969304 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:19:35.969304 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:19:35.969304 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:19:35.969304 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:19:35.969304 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:19:35.969304 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:19:35.969304 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:19:35.969304 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29d9c670-e34a-4363-9e60-745335a3ea6c could not be found. May 26 15:19:35.969304 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:19:35.969304 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:19:35.969304 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:19:35.969304 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:19:35.969304 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:19:35.969304 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:19:35.969304 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:19:35.969304 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:19:35.969304 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29d9c670-e34a-4363-9e60-745335a3ea6c could not be found. May 26 15:19:35.969304 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:19:35.971813 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a29d53db-2a26-4d4c-8256-4c5c9e3daab1 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] Returning 404 to user: Instance 29d9c670-e34a-4363-9e60-745335a3ea6c could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:19:35.971813 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a29d53db-2a26-4d4c-8256-4c5c9e3daab1 tempest-AttachVolumeTestJSON-336307212 tempest-AttachVolumeTestJSON-336307212-project] 10.222.0.45 "GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c" status: 404 len: 111 microversion: 2.1 time: 0.029930 May 26 15:19:35.971813 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 435/900] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:19:35 2022] GET /compute/v2.1/servers/29d9c670-e34a-4363-9e60-745335a3ea6c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:19:36.183691 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-eade44ca-f30e-46c5-95dd-47d7fff113f4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:19:36.184293 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-eade44ca-f30e-46c5-95dd-47d7fff113f4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:19:36.191507 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-eade44ca-f30e-46c5-95dd-47d7fff113f4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:36.191952 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-eade44ca-f30e-46c5-95dd-47d7fff113f4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:36.192723 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-eade44ca-f30e-46c5-95dd-47d7fff113f4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:19:36.193148 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-eade44ca-f30e-46c5-95dd-47d7fff113f4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:19:36.414449 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-eade44ca-f30e-46c5-95dd-47d7fff113f4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:36.422940 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-eade44ca-f30e-46c5-95dd-47d7fff113f4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:36.424577 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-eade44ca-f30e-46c5-95dd-47d7fff113f4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:19:36.425798 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-eade44ca-f30e-46c5-95dd-47d7fff113f4 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1719 microversion: 2.20 time: 0.246068 May 26 15:19:36.426357 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 466/901] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:19:36 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1719 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:20:16.303944 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=5 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:16.304817 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=56 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:16.454999 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:20:16.455333 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Thu May 26 15:20:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f/ips (ip 10.222.0.45) !!! May 26 15:20:16.505427 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-598f65ab-3463-46ac-b8a4-a810a88547f1 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:16.505925 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-598f65ab-3463-46ac-b8a4-a810a88547f1 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: bf3c9c21-27ca-402b-9e1a-66a72cefb32f] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:16.511925 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-598f65ab-3463-46ac-b8a4-a810a88547f1 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:16.512371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-598f65ab-3463-46ac-b8a4-a810a88547f1 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:16.513126 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-598f65ab-3463-46ac-b8a4-a810a88547f1 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:16.513554 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-598f65ab-3463-46ac-b8a4-a810a88547f1 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:16.537871 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-598f65ab-3463-46ac-b8a4-a810a88547f1 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f/ips" status: 200 len: 151 microversion: 2.1 time: 0.240205 May 26 15:20:16.538417 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 436/902] 10.222.0.45 () {58 vars in 1247 bytes} [Thu May 26 15:20:16 2022] GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f/ips => generated 151 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:20:17.858105 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-3b04e2bd-7faa-43ac-ab26-8b625619e589 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17f4caf6-4f6a-4857-84a5-7ae00250a5c2"}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:20:17.859783 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-3b04e2bd-7faa-43ac-ab26-8b625619e589 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: bf3c9c21-27ca-402b-9e1a-66a72cefb32f] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:17.861973 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:17.862625 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=9 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:17.868509 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-3b04e2bd-7faa-43ac-ab26-8b625619e589 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:17.868958 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-3b04e2bd-7faa-43ac-ab26-8b625619e589 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:17.869727 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-3b04e2bd-7faa-43ac-ab26-8b625619e589 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:17.870165 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-3b04e2bd-7faa-43ac-ab26-8b625619e589 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:18.132604 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-3b04e2bd-7faa-43ac-ab26-8b625619e589 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "POST /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278260 May 26 15:20:18.133324 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 467/903] 10.222.0.45 () {60 vars in 1322 bytes} [Thu May 26 15:20:17 2022] POST /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:20:25.730418 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-33d2e2ae-21ee-4382-9e68-21f95b8d50b4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:25.730966 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-33d2e2ae-21ee-4382-9e68-21f95b8d50b4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: bf3c9c21-27ca-402b-9e1a-66a72cefb32f] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:25.737682 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-33d2e2ae-21ee-4382-9e68-21f95b8d50b4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:25.738164 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-33d2e2ae-21ee-4382-9e68-21f95b8d50b4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:25.739049 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-33d2e2ae-21ee-4382-9e68-21f95b8d50b4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:25.739514 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-33d2e2ae-21ee-4382-9e68-21f95b8d50b4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:25.827174 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.objects.instance [None req-33d2e2ae-21ee-4382-9e68-21f95b8d50b4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lazy-loading 'services' on Instance uuid bf3c9c21-27ca-402b-9e1a-66a72cefb32f {{(pid=117798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:20:25.897491 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-33d2e2ae-21ee-4382-9e68-21f95b8d50b4 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "DELETE /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f/os-volume_attachments/17f4caf6-4f6a-4857-84a5-7ae00250a5c2" status: 202 len: 0 microversion: 2.1 time: 0.170812 May 26 15:20:25.898311 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 437/904] 10.222.0.45 () {58 vars in 1415 bytes} [Thu May 26 15:20:25 2022] DELETE /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f/os-volume_attachments/17f4caf6-4f6a-4857-84a5-7ae00250a5c2 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:20:25.909149 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-74113e09-2524-49ed-ab54-0eff87629d83 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:25.910063 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-74113e09-2524-49ed-ab54-0eff87629d83 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: bf3c9c21-27ca-402b-9e1a-66a72cefb32f] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:25.917893 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-74113e09-2524-49ed-ab54-0eff87629d83 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:25.918430 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-74113e09-2524-49ed-ab54-0eff87629d83 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:25.919332 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-74113e09-2524-49ed-ab54-0eff87629d83 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:25.919862 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-74113e09-2524-49ed-ab54-0eff87629d83 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:25.950588 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-74113e09-2524-49ed-ab54-0eff87629d83 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047837 May 26 15:20:25.951164 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 468/905] 10.222.0.45 () {58 vars in 1301 bytes} [Thu May 26 15:20:25 2022] GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:20:26.963052 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-20bd093e-9574-40c9-b341-dd498ba8c998 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:26.964119 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-20bd093e-9574-40c9-b341-dd498ba8c998 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: bf3c9c21-27ca-402b-9e1a-66a72cefb32f] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:26.971634 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-20bd093e-9574-40c9-b341-dd498ba8c998 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:26.972074 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-20bd093e-9574-40c9-b341-dd498ba8c998 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:26.972823 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-20bd093e-9574-40c9-b341-dd498ba8c998 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:26.973247 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-20bd093e-9574-40c9-b341-dd498ba8c998 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:27.001872 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-20bd093e-9574-40c9-b341-dd498ba8c998 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043644 May 26 15:20:27.002325 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 438/906] 10.222.0.45 () {58 vars in 1301 bytes} [Thu May 26 15:20:26 2022] GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 15:20:27.061914 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-f155d160-6c01-4d2f-acab-9c605ebb7f01 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:27.062663 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-f155d160-6c01-4d2f-acab-9c605ebb7f01 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: bf3c9c21-27ca-402b-9e1a-66a72cefb32f] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:27.069106 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f155d160-6c01-4d2f-acab-9c605ebb7f01 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:27.069609 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f155d160-6c01-4d2f-acab-9c605ebb7f01 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:27.070372 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f155d160-6c01-4d2f-acab-9c605ebb7f01 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:27.070810 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f155d160-6c01-4d2f-acab-9c605ebb7f01 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:27.098093 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-f155d160-6c01-4d2f-acab-9c605ebb7f01 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: bf3c9c21-27ca-402b-9e1a-66a72cefb32f] Going to try to terminate instance {{(pid=117799) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:20:27.178096 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-f155d160-6c01-4d2f-acab-9c605ebb7f01 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "DELETE /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f" status: 204 len: 0 microversion: 2.1 time: 0.119795 May 26 15:20:27.178727 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 469/907] 10.222.0.45 () {58 vars in 1238 bytes} [Thu May 26 15:20:27 2022] DELETE /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:20:27.188517 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-4a978478-48b1-4edc-b010-6c2469d42547 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:27.188517 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-4a978478-48b1-4edc-b010-6c2469d42547 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: bf3c9c21-27ca-402b-9e1a-66a72cefb32f] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:27.193996 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4a978478-48b1-4edc-b010-6c2469d42547 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:27.194435 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4a978478-48b1-4edc-b010-6c2469d42547 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:27.195216 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4a978478-48b1-4edc-b010-6c2469d42547 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:27.195642 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4a978478-48b1-4edc-b010-6c2469d42547 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:27.332255 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-4a978478-48b1-4edc-b010-6c2469d42547 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:27.340370 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-4a978478-48b1-4edc-b010-6c2469d42547 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f" status: 200 len: 1682 microversion: 2.1 time: 0.157136 May 26 15:20:27.340934 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 439/908] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:20:27 2022] GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:20:28.360123 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-8b2c1794-5cdf-4654-8532-db04536d2aaf tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:28.360824 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-8b2c1794-5cdf-4654-8532-db04536d2aaf tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: bf3c9c21-27ca-402b-9e1a-66a72cefb32f] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:28.367420 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8b2c1794-5cdf-4654-8532-db04536d2aaf tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:28.367878 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8b2c1794-5cdf-4654-8532-db04536d2aaf tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:28.368650 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8b2c1794-5cdf-4654-8532-db04536d2aaf tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:28.369089 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8b2c1794-5cdf-4654-8532-db04536d2aaf tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:28.501695 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-8b2c1794-5cdf-4654-8532-db04536d2aaf tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:28.510959 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-8b2c1794-5cdf-4654-8532-db04536d2aaf tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f" status: 200 len: 1682 microversion: 2.1 time: 0.155774 May 26 15:20:28.511545 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 470/909] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:20:28 2022] GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:20:29.528557 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f94f1707-ac44-4266-9840-deec08ca190e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:29.529168 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f94f1707-ac44-4266-9840-deec08ca190e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: bf3c9c21-27ca-402b-9e1a-66a72cefb32f] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:29.535888 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f94f1707-ac44-4266-9840-deec08ca190e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:29.536355 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f94f1707-ac44-4266-9840-deec08ca190e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:29.537171 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f94f1707-ac44-4266-9840-deec08ca190e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:29.537626 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f94f1707-ac44-4266-9840-deec08ca190e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:29.667554 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f94f1707-ac44-4266-9840-deec08ca190e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:29.675300 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f94f1707-ac44-4266-9840-deec08ca190e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f" status: 200 len: 1682 microversion: 2.1 time: 0.150568 May 26 15:20:29.675876 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 440/910] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:20:29 2022] GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:20:30.614824 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-834acd57-f4a6-444c-ae6d-976cbbed10fc req-2c44926a-57f2-49df-b772-8a486d772eb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf3c9c21-27ca-402b-9e1a-66a72cefb32f", "name": "network-vif-deleted", "tag": "d6fa16db-1301-4e83-aecd-89e7a66460a3"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:20:30.624298 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-834acd57-f4a6-444c-ae6d-976cbbed10fc req-2c44926a-57f2-49df-b772-8a486d772eb4 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:30.625140 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-834acd57-f4a6-444c-ae6d-976cbbed10fc req-2c44926a-57f2-49df-b772-8a486d772eb4 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:30.637969 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-834acd57-f4a6-444c-ae6d-976cbbed10fc req-2c44926a-57f2-49df-b772-8a486d772eb4 service nova] Creating event network-vif-deleted:d6fa16db-1301-4e83-aecd-89e7a66460a3 for instance bf3c9c21-27ca-402b-9e1a-66a72cefb32f on hv-cinder-84301 May 26 15:20:30.649326 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-834acd57-f4a6-444c-ae6d-976cbbed10fc req-2c44926a-57f2-49df-b772-8a486d772eb4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188652 May 26 15:20:30.649943 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 471/911] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:20:30.693989 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ffb7c02f-8c5e-4ee1-b5a7-0b1d91351192 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:30.694597 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ffb7c02f-8c5e-4ee1-b5a7-0b1d91351192 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: bf3c9c21-27ca-402b-9e1a-66a72cefb32f] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:30.701938 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ffb7c02f-8c5e-4ee1-b5a7-0b1d91351192 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:30.702471 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ffb7c02f-8c5e-4ee1-b5a7-0b1d91351192 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:30.704393 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ffb7c02f-8c5e-4ee1-b5a7-0b1d91351192 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:30.704831 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ffb7c02f-8c5e-4ee1-b5a7-0b1d91351192 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:30.742852 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ffb7c02f-8c5e-4ee1-b5a7-0b1d91351192 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:30.743564 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ffb7c02f-8c5e-4ee1-b5a7-0b1d91351192 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:30.743857 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.objects.instance [None req-ffb7c02f-8c5e-4ee1-b5a7-0b1d91351192 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lazy-loading 'fault' on Instance uuid bf3c9c21-27ca-402b-9e1a-66a72cefb32f {{(pid=117798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:20:30.785515 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ffb7c02f-8c5e-4ee1-b5a7-0b1d91351192 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1421fb674ae04d6ea9ae342b73ce8115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196700c560cd4d6e9461ec9571facf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:30.792909 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ffb7c02f-8c5e-4ee1-b5a7-0b1d91351192 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f" status: 200 len: 1331 microversion: 2.1 time: 0.102856 May 26 15:20:30.793480 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 441/912] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:20:30 2022] GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f => generated 1331 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:20:31.781842 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-2388f737-304f-4b9c-9743-c1c6e205a2e3 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:31.782518 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-2388f737-304f-4b9c-9743-c1c6e205a2e3 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 612ae9ec-d528-4264-afd3-373c904f50fd] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:31.788875 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2388f737-304f-4b9c-9743-c1c6e205a2e3 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:31.789329 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2388f737-304f-4b9c-9743-c1c6e205a2e3 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:31.790099 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2388f737-304f-4b9c-9743-c1c6e205a2e3 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:31.790537 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2388f737-304f-4b9c-9743-c1c6e205a2e3 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:31.811079 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c2572162-78e7-4515-9d13-97793e0d255a tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:31.811723 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c2572162-78e7-4515-9d13-97793e0d255a tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: bf3c9c21-27ca-402b-9e1a-66a72cefb32f] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:31.815455 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-2388f737-304f-4b9c-9743-c1c6e205a2e3 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 612ae9ec-d528-4264-afd3-373c904f50fd] Going to try to terminate instance {{(pid=117799) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:20:31.819851 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c2572162-78e7-4515-9d13-97793e0d255a tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:31.820298 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c2572162-78e7-4515-9d13-97793e0d255a tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:31.821066 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c2572162-78e7-4515-9d13-97793e0d255a tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:31.821576 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c2572162-78e7-4515-9d13-97793e0d255a tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:31.836105 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-c2572162-78e7-4515-9d13-97793e0d255a tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] HTTP exception thrown: Instance bf3c9c21-27ca-402b-9e1a-66a72cefb32f could not be found. May 26 15:20:31.837764 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c2572162-78e7-4515-9d13-97793e0d255a tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Request method failure captured: May 26 15:20:31.837764 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: request: GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f HTTP/1.1 May 26 15:20:31.837764 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept: application/json May 26 15:20:31.837764 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity May 26 15:20:31.837764 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Connection: close May 26 15:20:31.837764 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Length: 0 May 26 15:20:31.837764 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Type: application/json May 26 15:20:31.837764 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Host: 10.222.0.45 May 26 15:20:31.837764 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None May 26 15:20:31.837764 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 May 26 15:20:31.837764 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABij5gKsz5qj5DNdZrMFjr-Jr5xg2mNFFRPkTRxdAGsu10bP3EnBAcmrx6BKDNDgfsXd480T_XTCyywquChHsMxkBXmsyJsxmtyqnYAiCUvnNXzq6C4KvbHPcEIVG_Dh3vBN1K_0JPHyQtkc2u3wwrrdDbhsPbSJJLP4Pdm3CUM8QN6AT4 May 26 15:20:31.837764 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Id: None May 26 15:20:31.837764 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Name: None May 26 15:20:31.837764 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed May 26 15:20:31.837764 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True May 26 15:20:31.837764 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default May 26 15:20:31.837764 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default May 26 15:20:31.837764 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Id: 196700c560cd4d6e9461ec9571facf39 May 26 15:20:31.837764 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-AttachVolumeNegativeTest-1949965076 May 26 15:20:31.837764 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Role: reader,member May 26 15:20:31.837764 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Roles: reader,member May 26 15:20:31.839481 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/196700c560cd4d6e9461ec9571facf39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/196700c560cd4d6e9461ec9571facf39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/196700c560cd4d6e9461ec9571facf39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_196700c560cd4d6e9461ec9571facf39"}]}] May 26 15:20:31.839481 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-AttachVolumeNegativeTest-1949965076 May 26 15:20:31.839481 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Id: 196700c560cd4d6e9461ec9571facf39 May 26 15:20:31.839481 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1949965076 May 26 15:20:31.839481 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User: tempest-AttachVolumeNegativeTest-1949965076-project May 26 15:20:31.839481 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default May 26 15:20:31.839481 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default May 26 15:20:31.839481 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Id: 1421fb674ae04d6ea9ae342b73ce8115 May 26 15:20:31.839481 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-AttachVolumeNegativeTest-1949965076-project May 26 15:20:31.839481 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: method: > May 26 15:20:31.839481 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: exception: Instance bf3c9c21-27ca-402b-9e1a-66a72cefb32f could not be found. May 26 15:20:31.839481 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: action_args: {'id': 'bf3c9c21-27ca-402b-9e1a-66a72cefb32f'} May 26 15:20:31.840371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:20:31.840371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:20:31.840371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:20:31.840371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:20:31.840371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:20:31.840371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:20:31.840371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:20:31.840371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:20:31.840371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:20:31.840371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:20:31.840371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf3c9c21-27ca-402b-9e1a-66a72cefb32f could not be found. May 26 15:20:31.840371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:20:31.840371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:20:31.840371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:20:31.840371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:20:31.840371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:20:31.840371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:20:31.840371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:20:31.840371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:20:31.840371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:20:31.842000 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:20:31.842000 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:20:31.842000 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:20:31.842000 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:20:31.842000 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:20:31.842000 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:20:31.842000 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:20:31.842000 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf3c9c21-27ca-402b-9e1a-66a72cefb32f could not be found. May 26 15:20:31.842000 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:20:31.842000 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:20:31.842000 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:20:31.842000 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:20:31.842000 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:20:31.842000 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:20:31.842000 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:20:31.842000 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:20:31.842000 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf3c9c21-27ca-402b-9e1a-66a72cefb32f could not be found. May 26 15:20:31.842000 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:20:31.843557 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c2572162-78e7-4515-9d13-97793e0d255a tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Returning 404 to user: Instance bf3c9c21-27ca-402b-9e1a-66a72cefb32f could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:20:31.843557 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c2572162-78e7-4515-9d13-97793e0d255a tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f" status: 404 len: 111 microversion: 2.1 time: 0.031981 May 26 15:20:31.843557 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 442/913] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:20:31 2022] GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:20:31.848907 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-7598b8c1-13e3-413d-b09e-380158b7068f tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '.version_select at 0x7ffb5e83a1f0>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:31.872146 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-7598b8c1-13e3-413d-b09e-380158b7068f tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-171383666" status: 202 len: 0 microversion: 2.1 time: 0.026804 May 26 15:20:31.872724 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 443/914] 10.222.0.45 () {58 vars in 1217 bytes} [Thu May 26 15:20:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-171383666 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 15:20:31.899159 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-2388f737-304f-4b9c-9743-c1c6e205a2e3 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "DELETE /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd" status: 204 len: 0 microversion: 2.1 time: 0.121532 May 26 15:20:31.899960 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 472/915] 10.222.0.45 () {58 vars in 1238 bytes} [Thu May 26 15:20:31 2022] DELETE /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:20:31.909234 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-0ef1f96b-9746-4937-bd2b-8c0dc22174eb tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:31.909855 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-0ef1f96b-9746-4937-bd2b-8c0dc22174eb tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 612ae9ec-d528-4264-afd3-373c904f50fd] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:31.916707 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0ef1f96b-9746-4937-bd2b-8c0dc22174eb tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:31.917160 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0ef1f96b-9746-4937-bd2b-8c0dc22174eb tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:31.918032 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0ef1f96b-9746-4937-bd2b-8c0dc22174eb tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:31.918488 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0ef1f96b-9746-4937-bd2b-8c0dc22174eb tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:32.103964 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-0ef1f96b-9746-4937-bd2b-8c0dc22174eb tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:32.112920 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-0ef1f96b-9746-4937-bd2b-8c0dc22174eb tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd" status: 200 len: 1575 microversion: 2.1 time: 0.208161 May 26 15:20:32.113585 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 444/916] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:20:31 2022] GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd => generated 1575 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:20:33.136941 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-4784ad95-65db-44e8-b9f4-513afdef228d tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:33.138353 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-4784ad95-65db-44e8-b9f4-513afdef228d tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 612ae9ec-d528-4264-afd3-373c904f50fd] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:33.147763 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4784ad95-65db-44e8-b9f4-513afdef228d tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:33.148211 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4784ad95-65db-44e8-b9f4-513afdef228d tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:33.148996 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4784ad95-65db-44e8-b9f4-513afdef228d tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:33.149549 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4784ad95-65db-44e8-b9f4-513afdef228d tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:33.293910 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-4784ad95-65db-44e8-b9f4-513afdef228d tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:33.301396 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-4784ad95-65db-44e8-b9f4-513afdef228d tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd" status: 200 len: 1575 microversion: 2.1 time: 0.173715 May 26 15:20:33.301969 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 473/917] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:20:33 2022] GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:20:33.721409 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-de183678-87af-49ea-b54a-f1b476033f2e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:33.721927 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-de183678-87af-49ea-b54a-f1b476033f2e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: bf3c9c21-27ca-402b-9e1a-66a72cefb32f] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:33.728429 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-de183678-87af-49ea-b54a-f1b476033f2e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:33.728869 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-de183678-87af-49ea-b54a-f1b476033f2e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:33.729623 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-de183678-87af-49ea-b54a-f1b476033f2e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:33.730049 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-de183678-87af-49ea-b54a-f1b476033f2e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:33.743746 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-de183678-87af-49ea-b54a-f1b476033f2e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] HTTP exception thrown: Instance bf3c9c21-27ca-402b-9e1a-66a72cefb32f could not be found. May 26 15:20:33.745279 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-de183678-87af-49ea-b54a-f1b476033f2e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Request method failure captured: May 26 15:20:33.745279 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: request: DELETE /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f HTTP/1.1 May 26 15:20:33.745279 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept: application/json May 26 15:20:33.745279 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity May 26 15:20:33.745279 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Connection: close May 26 15:20:33.745279 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Length: 0 May 26 15:20:33.745279 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Type: application/json May 26 15:20:33.745279 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Host: 10.222.0.45 May 26 15:20:33.745279 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None May 26 15:20:33.745279 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 May 26 15:20:33.745279 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABij5gKsz5qj5DNdZrMFjr-Jr5xg2mNFFRPkTRxdAGsu10bP3EnBAcmrx6BKDNDgfsXd480T_XTCyywquChHsMxkBXmsyJsxmtyqnYAiCUvnNXzq6C4KvbHPcEIVG_Dh3vBN1K_0JPHyQtkc2u3wwrrdDbhsPbSJJLP4Pdm3CUM8QN6AT4 May 26 15:20:33.745279 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Id: None May 26 15:20:33.745279 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Name: None May 26 15:20:33.745279 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed May 26 15:20:33.745279 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True May 26 15:20:33.745279 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default May 26 15:20:33.745279 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default May 26 15:20:33.745279 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Id: 196700c560cd4d6e9461ec9571facf39 May 26 15:20:33.745279 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-AttachVolumeNegativeTest-1949965076 May 26 15:20:33.745279 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Role: reader,member May 26 15:20:33.745279 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Roles: reader,member May 26 15:20:33.746907 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/196700c560cd4d6e9461ec9571facf39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/196700c560cd4d6e9461ec9571facf39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/196700c560cd4d6e9461ec9571facf39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_196700c560cd4d6e9461ec9571facf39"}]}] May 26 15:20:33.746907 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-AttachVolumeNegativeTest-1949965076 May 26 15:20:33.746907 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Id: 196700c560cd4d6e9461ec9571facf39 May 26 15:20:33.746907 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1949965076 May 26 15:20:33.746907 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User: tempest-AttachVolumeNegativeTest-1949965076-project May 26 15:20:33.746907 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default May 26 15:20:33.746907 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default May 26 15:20:33.746907 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Id: 1421fb674ae04d6ea9ae342b73ce8115 May 26 15:20:33.746907 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-AttachVolumeNegativeTest-1949965076-project May 26 15:20:33.746907 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: method: > May 26 15:20:33.746907 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: exception: Instance bf3c9c21-27ca-402b-9e1a-66a72cefb32f could not be found. May 26 15:20:33.746907 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: action_args: {'id': 'bf3c9c21-27ca-402b-9e1a-66a72cefb32f'} May 26 15:20:33.747859 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:20:33.747859 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:20:33.747859 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:20:33.747859 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:20:33.747859 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:20:33.747859 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:20:33.747859 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:20:33.747859 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:20:33.747859 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:20:33.747859 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:20:33.747859 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf3c9c21-27ca-402b-9e1a-66a72cefb32f could not be found. May 26 15:20:33.747859 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:20:33.747859 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:20:33.747859 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:20:33.747859 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:20:33.747859 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:20:33.747859 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:20:33.747859 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:20:33.747859 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:20:33.747859 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:20:33.749369 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:20:33.749369 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 15:20:33.749369 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 15:20:33.749369 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 15:20:33.749369 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 15:20:33.749369 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:20:33.749369 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:20:33.749369 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:20:33.749369 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:20:33.749369 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf3c9c21-27ca-402b-9e1a-66a72cefb32f could not be found. May 26 15:20:33.749369 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:20:33.749369 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:20:33.749369 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:20:33.749369 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:20:33.749369 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:20:33.749369 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:20:33.749369 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:20:33.749369 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:20:33.749369 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf3c9c21-27ca-402b-9e1a-66a72cefb32f could not be found. May 26 15:20:33.749369 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:20:33.751696 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-de183678-87af-49ea-b54a-f1b476033f2e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Returning 404 to user: Instance bf3c9c21-27ca-402b-9e1a-66a72cefb32f could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:20:33.751696 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-de183678-87af-49ea-b54a-f1b476033f2e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "DELETE /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f" status: 404 len: 111 microversion: 2.1 time: 0.029605 May 26 15:20:33.751696 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 445/918] 10.222.0.45 () {58 vars in 1238 bytes} [Thu May 26 15:20:33 2022] DELETE /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:20:33.756146 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-2da50911-9e9e-4e69-b574-9352e26b56cf tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:33.756754 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-2da50911-9e9e-4e69-b574-9352e26b56cf tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: bf3c9c21-27ca-402b-9e1a-66a72cefb32f] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:33.762667 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2da50911-9e9e-4e69-b574-9352e26b56cf tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:33.763136 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2da50911-9e9e-4e69-b574-9352e26b56cf tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:33.763934 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2da50911-9e9e-4e69-b574-9352e26b56cf tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:33.764368 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2da50911-9e9e-4e69-b574-9352e26b56cf tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:33.777922 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.wsgi [None req-2da50911-9e9e-4e69-b574-9352e26b56cf tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] HTTP exception thrown: Instance bf3c9c21-27ca-402b-9e1a-66a72cefb32f could not be found. May 26 15:20:33.779610 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-2da50911-9e9e-4e69-b574-9352e26b56cf tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Request method failure captured: May 26 15:20:33.779610 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: request: GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f HTTP/1.1 May 26 15:20:33.779610 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept: application/json May 26 15:20:33.779610 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept-Encoding: identity May 26 15:20:33.779610 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Connection: close May 26 15:20:33.779610 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Length: 0 May 26 15:20:33.779610 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Type: application/json May 26 15:20:33.779610 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Host: 10.222.0.45 May 26 15:20:33.779610 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Openstack-System-Scope: None May 26 15:20:33.779610 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: User-Agent: python-urllib3/1.26.9 May 26 15:20:33.779610 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Auth-Token: gAAAAABij5gKsz5qj5DNdZrMFjr-Jr5xg2mNFFRPkTRxdAGsu10bP3EnBAcmrx6BKDNDgfsXd480T_XTCyywquChHsMxkBXmsyJsxmtyqnYAiCUvnNXzq6C4KvbHPcEIVG_Dh3vBN1K_0JPHyQtkc2u3wwrrdDbhsPbSJJLP4Pdm3CUM8QN6AT4 May 26 15:20:33.779610 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Id: None May 26 15:20:33.779610 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Name: None May 26 15:20:33.779610 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Identity-Status: Confirmed May 26 15:20:33.779610 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Is-Admin-Project: True May 26 15:20:33.779610 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Id: default May 26 15:20:33.779610 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Name: Default May 26 15:20:33.779610 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Id: 196700c560cd4d6e9461ec9571facf39 May 26 15:20:33.779610 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Name: tempest-AttachVolumeNegativeTest-1949965076 May 26 15:20:33.779610 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Role: reader,member May 26 15:20:33.779610 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Roles: reader,member May 26 15:20:33.781383 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/196700c560cd4d6e9461ec9571facf39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/196700c560cd4d6e9461ec9571facf39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/196700c560cd4d6e9461ec9571facf39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_196700c560cd4d6e9461ec9571facf39"}]}] May 26 15:20:33.781383 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant: tempest-AttachVolumeNegativeTest-1949965076 May 26 15:20:33.781383 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Id: 196700c560cd4d6e9461ec9571facf39 May 26 15:20:33.781383 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1949965076 May 26 15:20:33.781383 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User: tempest-AttachVolumeNegativeTest-1949965076-project May 26 15:20:33.781383 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Id: default May 26 15:20:33.781383 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Name: Default May 26 15:20:33.781383 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Id: 1421fb674ae04d6ea9ae342b73ce8115 May 26 15:20:33.781383 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Name: tempest-AttachVolumeNegativeTest-1949965076-project May 26 15:20:33.781383 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: method: > May 26 15:20:33.781383 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: exception: Instance bf3c9c21-27ca-402b-9e1a-66a72cefb32f could not be found. May 26 15:20:33.781383 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: action_args: {'id': 'bf3c9c21-27ca-402b-9e1a-66a72cefb32f'} May 26 15:20:33.782305 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:20:33.782305 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:20:33.782305 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:20:33.782305 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:20:33.782305 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:20:33.782305 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:20:33.782305 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:20:33.782305 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:20:33.782305 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:20:33.782305 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:20:33.782305 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf3c9c21-27ca-402b-9e1a-66a72cefb32f could not be found. May 26 15:20:33.782305 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:20:33.782305 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:20:33.782305 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:20:33.782305 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:20:33.782305 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:20:33.782305 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:20:33.782305 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:20:33.782305 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:20:33.782305 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:20:33.783849 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:20:33.783849 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:20:33.783849 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:20:33.783849 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:20:33.783849 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:20:33.783849 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:20:33.783849 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:20:33.783849 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf3c9c21-27ca-402b-9e1a-66a72cefb32f could not be found. May 26 15:20:33.783849 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:20:33.783849 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:20:33.783849 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:20:33.783849 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:20:33.783849 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:20:33.783849 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:20:33.783849 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:20:33.783849 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:20:33.783849 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf3c9c21-27ca-402b-9e1a-66a72cefb32f could not be found. May 26 15:20:33.783849 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:20:33.785045 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-2da50911-9e9e-4e69-b574-9352e26b56cf tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Returning 404 to user: Instance bf3c9c21-27ca-402b-9e1a-66a72cefb32f could not be found. {{(pid=117799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:20:33.785045 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-2da50911-9e9e-4e69-b574-9352e26b56cf tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f" status: 404 len: 111 microversion: 2.1 time: 0.028716 May 26 15:20:33.785045 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 474/919] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:20:33 2022] GET /compute/v2.1/servers/bf3c9c21-27ca-402b-9e1a-66a72cefb32f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 15:20:34.317996 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-6ed762bd-b068-4045-991f-3de256b33eaf tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:34.318533 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-6ed762bd-b068-4045-991f-3de256b33eaf tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 612ae9ec-d528-4264-afd3-373c904f50fd] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:34.324548 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6ed762bd-b068-4045-991f-3de256b33eaf tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:34.324997 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6ed762bd-b068-4045-991f-3de256b33eaf tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:34.325765 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6ed762bd-b068-4045-991f-3de256b33eaf tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:34.326198 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6ed762bd-b068-4045-991f-3de256b33eaf tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:34.464262 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6ed762bd-b068-4045-991f-3de256b33eaf tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:34.473300 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-6ed762bd-b068-4045-991f-3de256b33eaf tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd" status: 200 len: 1575 microversion: 2.1 time: 0.159269 May 26 15:20:34.473966 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 446/920] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:20:34 2022] GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:20:34.923619 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-63764524-90ee-4cfc-a466-def9884c1aa3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:34.924159 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-63764524-90ee-4cfc-a466-def9884c1aa3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 819b82d5-9c2d-4302-a0ad-ba9f20cac568] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:34.930753 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-63764524-90ee-4cfc-a466-def9884c1aa3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:34.931239 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-63764524-90ee-4cfc-a466-def9884c1aa3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:34.932011 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-63764524-90ee-4cfc-a466-def9884c1aa3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:34.932451 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-63764524-90ee-4cfc-a466-def9884c1aa3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:34.945956 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.wsgi [None req-63764524-90ee-4cfc-a466-def9884c1aa3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] HTTP exception thrown: Instance 819b82d5-9c2d-4302-a0ad-ba9f20cac568 could not be found. May 26 15:20:34.947583 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-63764524-90ee-4cfc-a466-def9884c1aa3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Request method failure captured: May 26 15:20:34.947583 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: request: DELETE /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568 HTTP/1.1 May 26 15:20:34.947583 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept: application/json May 26 15:20:34.947583 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept-Encoding: identity May 26 15:20:34.947583 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Connection: close May 26 15:20:34.947583 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Length: 0 May 26 15:20:34.947583 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Type: application/json May 26 15:20:34.947583 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Host: 10.222.0.45 May 26 15:20:34.947583 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Openstack-System-Scope: None May 26 15:20:34.947583 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: User-Agent: python-urllib3/1.26.9 May 26 15:20:34.947583 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Auth-Token: gAAAAABij5gKsz5qj5DNdZrMFjr-Jr5xg2mNFFRPkTRxdAGsu10bP3EnBAcmrx6BKDNDgfsXd480T_XTCyywquChHsMxkBXmsyJsxmtyqnYAiCUvnNXzq6C4KvbHPcEIVG_Dh3vBN1K_0JPHyQtkc2u3wwrrdDbhsPbSJJLP4Pdm3CUM8QN6AT4 May 26 15:20:34.947583 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Id: None May 26 15:20:34.947583 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Name: None May 26 15:20:34.947583 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Identity-Status: Confirmed May 26 15:20:34.947583 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Is-Admin-Project: True May 26 15:20:34.947583 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Id: default May 26 15:20:34.947583 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Name: Default May 26 15:20:34.947583 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Id: 196700c560cd4d6e9461ec9571facf39 May 26 15:20:34.947583 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Name: tempest-AttachVolumeNegativeTest-1949965076 May 26 15:20:34.947583 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Role: reader,member May 26 15:20:34.947583 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Roles: reader,member May 26 15:20:34.949122 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/196700c560cd4d6e9461ec9571facf39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/196700c560cd4d6e9461ec9571facf39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/196700c560cd4d6e9461ec9571facf39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_196700c560cd4d6e9461ec9571facf39"}]}] May 26 15:20:34.949122 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant: tempest-AttachVolumeNegativeTest-1949965076 May 26 15:20:34.949122 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Id: 196700c560cd4d6e9461ec9571facf39 May 26 15:20:34.949122 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1949965076 May 26 15:20:34.949122 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User: tempest-AttachVolumeNegativeTest-1949965076-project May 26 15:20:34.949122 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Id: default May 26 15:20:34.949122 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Name: Default May 26 15:20:34.949122 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Id: 1421fb674ae04d6ea9ae342b73ce8115 May 26 15:20:34.949122 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Name: tempest-AttachVolumeNegativeTest-1949965076-project May 26 15:20:34.949122 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: method: > May 26 15:20:34.949122 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: exception: Instance 819b82d5-9c2d-4302-a0ad-ba9f20cac568 could not be found. May 26 15:20:34.949122 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: action_args: {'id': '819b82d5-9c2d-4302-a0ad-ba9f20cac568'} May 26 15:20:34.949949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:20:34.949949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:20:34.949949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:20:34.949949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:20:34.949949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:20:34.949949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:20:34.949949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:20:34.949949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:20:34.949949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:20:34.949949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:20:34.949949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 819b82d5-9c2d-4302-a0ad-ba9f20cac568 could not be found. May 26 15:20:34.949949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:20:34.949949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:20:34.949949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:20:34.949949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:20:34.949949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:20:34.949949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:20:34.949949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:20:34.949949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:20:34.949949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:20:34.951182 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:20:34.951182 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 15:20:34.951182 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 15:20:34.951182 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 15:20:34.951182 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 15:20:34.951182 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:20:34.951182 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:20:34.951182 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:20:34.951182 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:20:34.951182 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 819b82d5-9c2d-4302-a0ad-ba9f20cac568 could not be found. May 26 15:20:34.951182 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:20:34.951182 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:20:34.951182 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:20:34.951182 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:20:34.951182 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:20:34.951182 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:20:34.951182 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:20:34.951182 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:20:34.951182 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 819b82d5-9c2d-4302-a0ad-ba9f20cac568 could not be found. May 26 15:20:34.951182 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:20:34.952977 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-63764524-90ee-4cfc-a466-def9884c1aa3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Returning 404 to user: Instance 819b82d5-9c2d-4302-a0ad-ba9f20cac568 could not be found. {{(pid=117799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:20:34.952977 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-63764524-90ee-4cfc-a466-def9884c1aa3 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "DELETE /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568" status: 404 len: 111 microversion: 2.1 time: 0.031072 May 26 15:20:34.952977 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 475/921] 10.222.0.45 () {58 vars in 1238 bytes} [Thu May 26 15:20:34 2022] DELETE /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:20:34.958103 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-fc4377be-a099-4be1-bed6-69d05b6bd3a7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:34.958710 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-fc4377be-a099-4be1-bed6-69d05b6bd3a7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 819b82d5-9c2d-4302-a0ad-ba9f20cac568] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:34.965386 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fc4377be-a099-4be1-bed6-69d05b6bd3a7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:34.965832 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fc4377be-a099-4be1-bed6-69d05b6bd3a7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:34.966603 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fc4377be-a099-4be1-bed6-69d05b6bd3a7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:34.967033 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fc4377be-a099-4be1-bed6-69d05b6bd3a7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:34.982607 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-fc4377be-a099-4be1-bed6-69d05b6bd3a7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] HTTP exception thrown: Instance 819b82d5-9c2d-4302-a0ad-ba9f20cac568 could not be found. May 26 15:20:34.985457 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-fc4377be-a099-4be1-bed6-69d05b6bd3a7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Request method failure captured: May 26 15:20:34.985457 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: request: GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568 HTTP/1.1 May 26 15:20:34.985457 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept: application/json May 26 15:20:34.985457 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity May 26 15:20:34.985457 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Connection: close May 26 15:20:34.985457 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Length: 0 May 26 15:20:34.985457 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Type: application/json May 26 15:20:34.985457 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Host: 10.222.0.45 May 26 15:20:34.985457 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None May 26 15:20:34.985457 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 May 26 15:20:34.985457 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABij5gKsz5qj5DNdZrMFjr-Jr5xg2mNFFRPkTRxdAGsu10bP3EnBAcmrx6BKDNDgfsXd480T_XTCyywquChHsMxkBXmsyJsxmtyqnYAiCUvnNXzq6C4KvbHPcEIVG_Dh3vBN1K_0JPHyQtkc2u3wwrrdDbhsPbSJJLP4Pdm3CUM8QN6AT4 May 26 15:20:34.985457 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Id: None May 26 15:20:34.985457 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Name: None May 26 15:20:34.985457 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed May 26 15:20:34.985457 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True May 26 15:20:34.985457 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default May 26 15:20:34.985457 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default May 26 15:20:34.985457 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Id: 196700c560cd4d6e9461ec9571facf39 May 26 15:20:34.985457 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-AttachVolumeNegativeTest-1949965076 May 26 15:20:34.985457 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Role: reader,member May 26 15:20:34.985457 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Roles: reader,member May 26 15:20:34.987773 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/196700c560cd4d6e9461ec9571facf39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/196700c560cd4d6e9461ec9571facf39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/196700c560cd4d6e9461ec9571facf39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_196700c560cd4d6e9461ec9571facf39"}]}] May 26 15:20:34.987773 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-AttachVolumeNegativeTest-1949965076 May 26 15:20:34.987773 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Id: 196700c560cd4d6e9461ec9571facf39 May 26 15:20:34.987773 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1949965076 May 26 15:20:34.987773 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User: tempest-AttachVolumeNegativeTest-1949965076-project May 26 15:20:34.987773 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default May 26 15:20:34.987773 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default May 26 15:20:34.987773 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Id: 1421fb674ae04d6ea9ae342b73ce8115 May 26 15:20:34.987773 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-AttachVolumeNegativeTest-1949965076-project May 26 15:20:34.987773 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: method: > May 26 15:20:34.987773 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: exception: Instance 819b82d5-9c2d-4302-a0ad-ba9f20cac568 could not be found. May 26 15:20:34.987773 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: action_args: {'id': '819b82d5-9c2d-4302-a0ad-ba9f20cac568'} May 26 15:20:34.988574 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:20:34.988574 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:20:34.988574 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:20:34.988574 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:20:34.988574 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:20:34.988574 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:20:34.988574 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:20:34.988574 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:20:34.988574 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:20:34.988574 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:20:34.988574 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 819b82d5-9c2d-4302-a0ad-ba9f20cac568 could not be found. May 26 15:20:34.988574 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:20:34.988574 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:20:34.988574 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:20:34.988574 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:20:34.988574 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:20:34.988574 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:20:34.988574 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:20:34.988574 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:20:34.988574 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:20:34.989767 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:20:34.989767 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:20:34.989767 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:20:34.989767 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:20:34.989767 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:20:34.989767 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:20:34.989767 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:20:34.989767 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 819b82d5-9c2d-4302-a0ad-ba9f20cac568 could not be found. May 26 15:20:34.989767 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:20:34.989767 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:20:34.989767 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:20:34.989767 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:20:34.989767 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:20:34.989767 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:20:34.989767 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:20:34.989767 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:20:34.989767 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 819b82d5-9c2d-4302-a0ad-ba9f20cac568 could not be found. May 26 15:20:34.989767 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:20:34.991675 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-fc4377be-a099-4be1-bed6-69d05b6bd3a7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Returning 404 to user: Instance 819b82d5-9c2d-4302-a0ad-ba9f20cac568 could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:20:34.991675 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-fc4377be-a099-4be1-bed6-69d05b6bd3a7 tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568" status: 404 len: 111 microversion: 2.1 time: 0.032619 May 26 15:20:34.991675 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 447/922] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:20:34 2022] GET /compute/v2.1/servers/819b82d5-9c2d-4302-a0ad-ba9f20cac568 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:20:34.995751 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-960a6327-59b2-4088-966b-d9a9378f09af tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:34.996247 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-960a6327-59b2-4088-966b-d9a9378f09af tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 966278e6-017a-4267-a3b1-98edbcde5e16] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:35.003324 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-960a6327-59b2-4088-966b-d9a9378f09af tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:35.003774 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-960a6327-59b2-4088-966b-d9a9378f09af tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:35.004577 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-960a6327-59b2-4088-966b-d9a9378f09af tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:35.005033 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-960a6327-59b2-4088-966b-d9a9378f09af tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:35.021737 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.wsgi [None req-960a6327-59b2-4088-966b-d9a9378f09af tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] HTTP exception thrown: Instance 966278e6-017a-4267-a3b1-98edbcde5e16 could not be found. May 26 15:20:35.023347 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-960a6327-59b2-4088-966b-d9a9378f09af tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Request method failure captured: May 26 15:20:35.023347 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: request: DELETE /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16 HTTP/1.1 May 26 15:20:35.023347 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept: application/json May 26 15:20:35.023347 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept-Encoding: identity May 26 15:20:35.023347 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Connection: close May 26 15:20:35.023347 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Length: 0 May 26 15:20:35.023347 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Type: application/json May 26 15:20:35.023347 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Host: 10.222.0.45 May 26 15:20:35.023347 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Openstack-System-Scope: None May 26 15:20:35.023347 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: User-Agent: python-urllib3/1.26.9 May 26 15:20:35.023347 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Auth-Token: gAAAAABij5gKsz5qj5DNdZrMFjr-Jr5xg2mNFFRPkTRxdAGsu10bP3EnBAcmrx6BKDNDgfsXd480T_XTCyywquChHsMxkBXmsyJsxmtyqnYAiCUvnNXzq6C4KvbHPcEIVG_Dh3vBN1K_0JPHyQtkc2u3wwrrdDbhsPbSJJLP4Pdm3CUM8QN6AT4 May 26 15:20:35.023347 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Id: None May 26 15:20:35.023347 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Name: None May 26 15:20:35.023347 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Identity-Status: Confirmed May 26 15:20:35.023347 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Is-Admin-Project: True May 26 15:20:35.023347 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Id: default May 26 15:20:35.023347 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Name: Default May 26 15:20:35.023347 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Id: 196700c560cd4d6e9461ec9571facf39 May 26 15:20:35.023347 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Name: tempest-AttachVolumeNegativeTest-1949965076 May 26 15:20:35.023347 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Role: reader,member May 26 15:20:35.023347 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Roles: reader,member May 26 15:20:35.024951 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/196700c560cd4d6e9461ec9571facf39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/196700c560cd4d6e9461ec9571facf39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/196700c560cd4d6e9461ec9571facf39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_196700c560cd4d6e9461ec9571facf39"}]}] May 26 15:20:35.024951 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant: tempest-AttachVolumeNegativeTest-1949965076 May 26 15:20:35.024951 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Id: 196700c560cd4d6e9461ec9571facf39 May 26 15:20:35.024951 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1949965076 May 26 15:20:35.024951 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User: tempest-AttachVolumeNegativeTest-1949965076-project May 26 15:20:35.024951 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Id: default May 26 15:20:35.024951 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Name: Default May 26 15:20:35.024951 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Id: 1421fb674ae04d6ea9ae342b73ce8115 May 26 15:20:35.024951 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Name: tempest-AttachVolumeNegativeTest-1949965076-project May 26 15:20:35.024951 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: method: > May 26 15:20:35.024951 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: exception: Instance 966278e6-017a-4267-a3b1-98edbcde5e16 could not be found. May 26 15:20:35.024951 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: action_args: {'id': '966278e6-017a-4267-a3b1-98edbcde5e16'} May 26 15:20:35.025728 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:20:35.025728 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:20:35.025728 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:20:35.025728 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:20:35.025728 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:20:35.025728 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:20:35.025728 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:20:35.025728 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:20:35.025728 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:20:35.025728 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:20:35.025728 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 966278e6-017a-4267-a3b1-98edbcde5e16 could not be found. May 26 15:20:35.025728 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:20:35.025728 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:20:35.025728 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:20:35.025728 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:20:35.025728 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:20:35.025728 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:20:35.025728 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:20:35.025728 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:20:35.025728 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:20:35.026973 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:20:35.026973 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 15:20:35.026973 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 15:20:35.026973 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 15:20:35.026973 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 15:20:35.026973 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:20:35.026973 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:20:35.026973 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:20:35.026973 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:20:35.026973 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 966278e6-017a-4267-a3b1-98edbcde5e16 could not be found. May 26 15:20:35.026973 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:20:35.026973 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:20:35.026973 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:20:35.026973 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:20:35.026973 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:20:35.026973 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:20:35.026973 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:20:35.026973 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:20:35.026973 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 966278e6-017a-4267-a3b1-98edbcde5e16 could not be found. May 26 15:20:35.026973 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:20:35.028212 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-960a6327-59b2-4088-966b-d9a9378f09af tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Returning 404 to user: Instance 966278e6-017a-4267-a3b1-98edbcde5e16 could not be found. {{(pid=117799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:20:35.028212 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-960a6327-59b2-4088-966b-d9a9378f09af tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "DELETE /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16" status: 404 len: 111 microversion: 2.1 time: 0.032892 May 26 15:20:35.028212 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 476/923] 10.222.0.45 () {58 vars in 1238 bytes} [Thu May 26 15:20:34 2022] DELETE /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:20:35.035213 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d0b575b4-9930-4dee-b793-eb2fb3142b6a tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:35.037542 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-d0b575b4-9930-4dee-b793-eb2fb3142b6a tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: 966278e6-017a-4267-a3b1-98edbcde5e16] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:35.042406 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d0b575b4-9930-4dee-b793-eb2fb3142b6a tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:35.042850 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d0b575b4-9930-4dee-b793-eb2fb3142b6a tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:35.043668 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d0b575b4-9930-4dee-b793-eb2fb3142b6a tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:35.044095 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d0b575b4-9930-4dee-b793-eb2fb3142b6a tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:35.059383 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-d0b575b4-9930-4dee-b793-eb2fb3142b6a tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] HTTP exception thrown: Instance 966278e6-017a-4267-a3b1-98edbcde5e16 could not be found. May 26 15:20:35.060933 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d0b575b4-9930-4dee-b793-eb2fb3142b6a tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Request method failure captured: May 26 15:20:35.060933 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: request: GET /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16 HTTP/1.1 May 26 15:20:35.060933 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept: application/json May 26 15:20:35.060933 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity May 26 15:20:35.060933 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Connection: close May 26 15:20:35.060933 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Length: 0 May 26 15:20:35.060933 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Type: application/json May 26 15:20:35.060933 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Host: 10.222.0.45 May 26 15:20:35.060933 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None May 26 15:20:35.060933 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 May 26 15:20:35.060933 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABij5gKsz5qj5DNdZrMFjr-Jr5xg2mNFFRPkTRxdAGsu10bP3EnBAcmrx6BKDNDgfsXd480T_XTCyywquChHsMxkBXmsyJsxmtyqnYAiCUvnNXzq6C4KvbHPcEIVG_Dh3vBN1K_0JPHyQtkc2u3wwrrdDbhsPbSJJLP4Pdm3CUM8QN6AT4 May 26 15:20:35.060933 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Id: None May 26 15:20:35.060933 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Name: None May 26 15:20:35.060933 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed May 26 15:20:35.060933 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True May 26 15:20:35.060933 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default May 26 15:20:35.060933 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default May 26 15:20:35.060933 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Id: 196700c560cd4d6e9461ec9571facf39 May 26 15:20:35.060933 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-AttachVolumeNegativeTest-1949965076 May 26 15:20:35.060933 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Role: reader,member May 26 15:20:35.060933 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Roles: reader,member May 26 15:20:35.062583 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/196700c560cd4d6e9461ec9571facf39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/196700c560cd4d6e9461ec9571facf39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/196700c560cd4d6e9461ec9571facf39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_196700c560cd4d6e9461ec9571facf39"}]}] May 26 15:20:35.062583 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-AttachVolumeNegativeTest-1949965076 May 26 15:20:35.062583 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Id: 196700c560cd4d6e9461ec9571facf39 May 26 15:20:35.062583 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1949965076 May 26 15:20:35.062583 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User: tempest-AttachVolumeNegativeTest-1949965076-project May 26 15:20:35.062583 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default May 26 15:20:35.062583 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default May 26 15:20:35.062583 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Id: 1421fb674ae04d6ea9ae342b73ce8115 May 26 15:20:35.062583 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-AttachVolumeNegativeTest-1949965076-project May 26 15:20:35.062583 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: method: > May 26 15:20:35.062583 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: exception: Instance 966278e6-017a-4267-a3b1-98edbcde5e16 could not be found. May 26 15:20:35.062583 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: action_args: {'id': '966278e6-017a-4267-a3b1-98edbcde5e16'} May 26 15:20:35.063362 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:20:35.063362 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:20:35.063362 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:20:35.063362 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:20:35.063362 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:20:35.063362 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:20:35.063362 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:20:35.063362 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:20:35.063362 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:20:35.063362 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:20:35.063362 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 966278e6-017a-4267-a3b1-98edbcde5e16 could not be found. May 26 15:20:35.063362 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:20:35.063362 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:20:35.063362 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:20:35.063362 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:20:35.063362 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:20:35.063362 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:20:35.063362 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:20:35.063362 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:20:35.063362 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:20:35.064573 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:20:35.064573 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:20:35.064573 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:20:35.064573 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:20:35.064573 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:20:35.064573 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:20:35.064573 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:20:35.064573 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 966278e6-017a-4267-a3b1-98edbcde5e16 could not be found. May 26 15:20:35.064573 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:20:35.064573 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:20:35.064573 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:20:35.064573 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:20:35.064573 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:20:35.064573 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:20:35.064573 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:20:35.064573 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:20:35.064573 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 966278e6-017a-4267-a3b1-98edbcde5e16 could not be found. May 26 15:20:35.064573 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:20:35.065976 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d0b575b4-9930-4dee-b793-eb2fb3142b6a tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Returning 404 to user: Instance 966278e6-017a-4267-a3b1-98edbcde5e16 could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:20:35.065976 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-d0b575b4-9930-4dee-b793-eb2fb3142b6a tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16" status: 404 len: 111 microversion: 2.1 time: 0.032543 May 26 15:20:35.065976 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 448/924] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:20:35 2022] GET /compute/v2.1/servers/966278e6-017a-4267-a3b1-98edbcde5e16 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 15:20:35.305610 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-0f9ff8c0-78ab-48d8-b1a4-3e456c70fcf3 req-d68e104d-0b6b-4d33-b1c4-488dd1bf01ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "612ae9ec-d528-4264-afd3-373c904f50fd", "name": "network-vif-deleted", "tag": "ef765667-706d-434f-bd38-174e92d9e085"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:20:35.315463 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-0f9ff8c0-78ab-48d8-b1a4-3e456c70fcf3 req-d68e104d-0b6b-4d33-b1c4-488dd1bf01ba service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:35.315908 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-0f9ff8c0-78ab-48d8-b1a4-3e456c70fcf3 req-d68e104d-0b6b-4d33-b1c4-488dd1bf01ba service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:35.327219 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-0f9ff8c0-78ab-48d8-b1a4-3e456c70fcf3 req-d68e104d-0b6b-4d33-b1c4-488dd1bf01ba service nova] Creating event network-vif-deleted:ef765667-706d-434f-bd38-174e92d9e085 for instance 612ae9ec-d528-4264-afd3-373c904f50fd on hv-cinder-84301 May 26 15:20:35.334996 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-0f9ff8c0-78ab-48d8-b1a4-3e456c70fcf3 req-d68e104d-0b6b-4d33-b1c4-488dd1bf01ba service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033132 May 26 15:20:35.335864 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 477/925] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:20:35.490648 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-9abe6259-1ff7-423a-adc2-d426728265db tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:35.491473 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-9abe6259-1ff7-423a-adc2-d426728265db tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 612ae9ec-d528-4264-afd3-373c904f50fd] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:35.497809 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9abe6259-1ff7-423a-adc2-d426728265db tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:35.498425 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9abe6259-1ff7-423a-adc2-d426728265db tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:35.499466 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9abe6259-1ff7-423a-adc2-d426728265db tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:35.500058 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9abe6259-1ff7-423a-adc2-d426728265db tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:35.581704 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-9abe6259-1ff7-423a-adc2-d426728265db tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:35.590653 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-9abe6259-1ff7-423a-adc2-d426728265db tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd" status: 200 len: 1224 microversion: 2.1 time: 0.103767 May 26 15:20:35.600556 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 449/926] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:20:35 2022] GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd => generated 1224 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:20:36.251062 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-e55812fc-64e7-4188-a4a9-d29b2acd662b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:36.251675 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-e55812fc-64e7-4188-a4a9-d29b2acd662b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:36.257830 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e55812fc-64e7-4188-a4a9-d29b2acd662b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:36.258277 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e55812fc-64e7-4188-a4a9-d29b2acd662b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:36.259051 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e55812fc-64e7-4188-a4a9-d29b2acd662b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:36.259507 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e55812fc-64e7-4188-a4a9-d29b2acd662b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:36.273263 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.wsgi [None req-e55812fc-64e7-4188-a4a9-d29b2acd662b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] HTTP exception thrown: Instance f969f1fa-bb13-4b63-9095-0881db5202df could not be found. May 26 15:20:36.274925 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-e55812fc-64e7-4188-a4a9-d29b2acd662b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Request method failure captured: May 26 15:20:36.274925 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: request: DELETE /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df HTTP/1.1 May 26 15:20:36.274925 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept: application/json May 26 15:20:36.274925 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept-Encoding: identity May 26 15:20:36.274925 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Connection: close May 26 15:20:36.274925 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Length: 0 May 26 15:20:36.274925 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Type: application/json May 26 15:20:36.274925 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Host: 10.222.0.45 May 26 15:20:36.274925 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Openstack-System-Scope: None May 26 15:20:36.274925 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: User-Agent: python-urllib3/1.26.9 May 26 15:20:36.274925 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Auth-Token: gAAAAABij5gKsz5qj5DNdZrMFjr-Jr5xg2mNFFRPkTRxdAGsu10bP3EnBAcmrx6BKDNDgfsXd480T_XTCyywquChHsMxkBXmsyJsxmtyqnYAiCUvnNXzq6C4KvbHPcEIVG_Dh3vBN1K_0JPHyQtkc2u3wwrrdDbhsPbSJJLP4Pdm3CUM8QN6AT4 May 26 15:20:36.274925 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Id: None May 26 15:20:36.274925 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Name: None May 26 15:20:36.274925 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Identity-Status: Confirmed May 26 15:20:36.274925 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Is-Admin-Project: True May 26 15:20:36.274925 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Id: default May 26 15:20:36.274925 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Name: Default May 26 15:20:36.274925 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Id: 196700c560cd4d6e9461ec9571facf39 May 26 15:20:36.274925 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Name: tempest-AttachVolumeNegativeTest-1949965076 May 26 15:20:36.274925 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Role: reader,member May 26 15:20:36.274925 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Roles: reader,member May 26 15:20:36.276522 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/196700c560cd4d6e9461ec9571facf39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/196700c560cd4d6e9461ec9571facf39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/196700c560cd4d6e9461ec9571facf39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_196700c560cd4d6e9461ec9571facf39"}]}] May 26 15:20:36.276522 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant: tempest-AttachVolumeNegativeTest-1949965076 May 26 15:20:36.276522 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Id: 196700c560cd4d6e9461ec9571facf39 May 26 15:20:36.276522 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1949965076 May 26 15:20:36.276522 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User: tempest-AttachVolumeNegativeTest-1949965076-project May 26 15:20:36.276522 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Id: default May 26 15:20:36.276522 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Name: Default May 26 15:20:36.276522 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Id: 1421fb674ae04d6ea9ae342b73ce8115 May 26 15:20:36.276522 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Name: tempest-AttachVolumeNegativeTest-1949965076-project May 26 15:20:36.276522 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: method: > May 26 15:20:36.276522 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: exception: Instance f969f1fa-bb13-4b63-9095-0881db5202df could not be found. May 26 15:20:36.276522 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: action_args: {'id': 'f969f1fa-bb13-4b63-9095-0881db5202df'} May 26 15:20:36.277320 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:20:36.277320 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:20:36.277320 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:20:36.277320 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:20:36.277320 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:20:36.277320 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:20:36.277320 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:20:36.277320 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:20:36.277320 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:20:36.277320 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:20:36.277320 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f969f1fa-bb13-4b63-9095-0881db5202df could not be found. May 26 15:20:36.277320 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:20:36.277320 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:20:36.277320 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:20:36.277320 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:20:36.277320 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:20:36.277320 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:20:36.277320 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:20:36.277320 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:20:36.277320 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:20:36.278596 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:20:36.278596 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 15:20:36.278596 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 15:20:36.278596 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 15:20:36.278596 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 15:20:36.278596 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:20:36.278596 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:20:36.278596 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:20:36.278596 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:20:36.278596 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f969f1fa-bb13-4b63-9095-0881db5202df could not be found. May 26 15:20:36.278596 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:20:36.278596 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:20:36.278596 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:20:36.278596 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:20:36.278596 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:20:36.278596 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:20:36.278596 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:20:36.278596 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:20:36.278596 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f969f1fa-bb13-4b63-9095-0881db5202df could not be found. May 26 15:20:36.278596 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:20:36.279812 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-e55812fc-64e7-4188-a4a9-d29b2acd662b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Returning 404 to user: Instance f969f1fa-bb13-4b63-9095-0881db5202df could not be found. {{(pid=117799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:20:36.279812 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-e55812fc-64e7-4188-a4a9-d29b2acd662b tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 404 len: 111 microversion: 2.1 time: 0.030394 May 26 15:20:36.279812 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 478/927] 10.222.0.45 () {58 vars in 1238 bytes} [Thu May 26 15:20:36 2022] DELETE /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:20:36.286187 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-7e5180dc-7e4f-41e0-9b0e-953cf722679e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:36.286996 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-7e5180dc-7e4f-41e0-9b0e-953cf722679e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] [instance: f969f1fa-bb13-4b63-9095-0881db5202df] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:36.293996 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7e5180dc-7e4f-41e0-9b0e-953cf722679e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:36.294449 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7e5180dc-7e4f-41e0-9b0e-953cf722679e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:36.295271 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7e5180dc-7e4f-41e0-9b0e-953cf722679e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:36.295776 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7e5180dc-7e4f-41e0-9b0e-953cf722679e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:36.310508 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-7e5180dc-7e4f-41e0-9b0e-953cf722679e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] HTTP exception thrown: Instance f969f1fa-bb13-4b63-9095-0881db5202df could not be found. May 26 15:20:36.312254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-7e5180dc-7e4f-41e0-9b0e-953cf722679e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Request method failure captured: May 26 15:20:36.312254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: request: GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df HTTP/1.1 May 26 15:20:36.312254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept: application/json May 26 15:20:36.312254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity May 26 15:20:36.312254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Connection: close May 26 15:20:36.312254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Length: 0 May 26 15:20:36.312254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Type: application/json May 26 15:20:36.312254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Host: 10.222.0.45 May 26 15:20:36.312254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None May 26 15:20:36.312254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 May 26 15:20:36.312254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABij5gKsz5qj5DNdZrMFjr-Jr5xg2mNFFRPkTRxdAGsu10bP3EnBAcmrx6BKDNDgfsXd480T_XTCyywquChHsMxkBXmsyJsxmtyqnYAiCUvnNXzq6C4KvbHPcEIVG_Dh3vBN1K_0JPHyQtkc2u3wwrrdDbhsPbSJJLP4Pdm3CUM8QN6AT4 May 26 15:20:36.312254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Id: None May 26 15:20:36.312254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Name: None May 26 15:20:36.312254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed May 26 15:20:36.312254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True May 26 15:20:36.312254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default May 26 15:20:36.312254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default May 26 15:20:36.312254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Id: 196700c560cd4d6e9461ec9571facf39 May 26 15:20:36.312254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-AttachVolumeNegativeTest-1949965076 May 26 15:20:36.312254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Role: reader,member May 26 15:20:36.312254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Roles: reader,member May 26 15:20:36.313839 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/196700c560cd4d6e9461ec9571facf39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/196700c560cd4d6e9461ec9571facf39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/196700c560cd4d6e9461ec9571facf39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_196700c560cd4d6e9461ec9571facf39"}]}] May 26 15:20:36.313839 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-AttachVolumeNegativeTest-1949965076 May 26 15:20:36.313839 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Id: 196700c560cd4d6e9461ec9571facf39 May 26 15:20:36.313839 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1949965076 May 26 15:20:36.313839 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User: tempest-AttachVolumeNegativeTest-1949965076-project May 26 15:20:36.313839 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default May 26 15:20:36.313839 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default May 26 15:20:36.313839 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Id: 1421fb674ae04d6ea9ae342b73ce8115 May 26 15:20:36.313839 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-AttachVolumeNegativeTest-1949965076-project May 26 15:20:36.313839 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: method: > May 26 15:20:36.313839 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: exception: Instance f969f1fa-bb13-4b63-9095-0881db5202df could not be found. May 26 15:20:36.313839 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: action_args: {'id': 'f969f1fa-bb13-4b63-9095-0881db5202df'} May 26 15:20:36.314985 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:20:36.314985 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:20:36.314985 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:20:36.314985 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:20:36.314985 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:20:36.314985 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:20:36.314985 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:20:36.314985 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:20:36.314985 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:20:36.314985 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:20:36.314985 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f969f1fa-bb13-4b63-9095-0881db5202df could not be found. May 26 15:20:36.314985 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:20:36.314985 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:20:36.314985 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:20:36.314985 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:20:36.314985 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:20:36.314985 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:20:36.314985 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:20:36.314985 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:20:36.314985 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:20:36.316254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:20:36.316254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:20:36.316254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:20:36.316254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:20:36.316254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:20:36.316254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:20:36.316254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:20:36.316254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f969f1fa-bb13-4b63-9095-0881db5202df could not be found. May 26 15:20:36.316254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:20:36.316254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:20:36.316254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:20:36.316254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:20:36.316254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:20:36.316254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:20:36.316254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:20:36.316254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:20:36.316254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f969f1fa-bb13-4b63-9095-0881db5202df could not be found. May 26 15:20:36.316254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:20:36.317411 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-7e5180dc-7e4f-41e0-9b0e-953cf722679e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] Returning 404 to user: Instance f969f1fa-bb13-4b63-9095-0881db5202df could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:20:36.317411 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-7e5180dc-7e4f-41e0-9b0e-953cf722679e tempest-AttachVolumeNegativeTest-1949965076 tempest-AttachVolumeNegativeTest-1949965076-project] 10.222.0.45 "GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df" status: 404 len: 111 microversion: 2.1 time: 0.031860 May 26 15:20:36.317411 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 450/928] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:20:36 2022] GET /compute/v2.1/servers/f969f1fa-bb13-4b63-9095-0881db5202df => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:20:36.607893 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-a892a0d2-0323-4c39-ae96-45b412b4da42 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:36.609198 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-a892a0d2-0323-4c39-ae96-45b412b4da42 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 612ae9ec-d528-4264-afd3-373c904f50fd] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:36.615405 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a892a0d2-0323-4c39-ae96-45b412b4da42 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:36.615947 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a892a0d2-0323-4c39-ae96-45b412b4da42 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:36.616785 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a892a0d2-0323-4c39-ae96-45b412b4da42 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:36.617294 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a892a0d2-0323-4c39-ae96-45b412b4da42 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:36.631676 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.wsgi [None req-a892a0d2-0323-4c39-ae96-45b412b4da42 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] HTTP exception thrown: Instance 612ae9ec-d528-4264-afd3-373c904f50fd could not be found. May 26 15:20:36.633218 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-a892a0d2-0323-4c39-ae96-45b412b4da42 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Request method failure captured: May 26 15:20:36.633218 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: request: GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd HTTP/1.1 May 26 15:20:36.633218 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept: application/json May 26 15:20:36.633218 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept-Encoding: identity May 26 15:20:36.633218 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Connection: close May 26 15:20:36.633218 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Length: 0 May 26 15:20:36.633218 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Type: application/json May 26 15:20:36.633218 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Host: 10.222.0.45 May 26 15:20:36.633218 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Openstack-System-Scope: None May 26 15:20:36.633218 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: User-Agent: python-urllib3/1.26.9 May 26 15:20:36.633218 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Auth-Token: gAAAAABij5nexOfvx9HOyJdMFv0iYw26G55P0mcIJ964qVRlBpnl5dDkcp5teDBUHs1fAiDyrF3SCEhLZfW8wetD5OqfpnRwTYGwKNFfkkYJ5jLmXcaV-DxhyVIa0__cD3b3mLD86YOWSidiK3Rp0MY0Do-Ig3pSvtmTqKtdOWnzn_eFIrSO7Dw May 26 15:20:36.633218 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Id: None May 26 15:20:36.633218 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Name: None May 26 15:20:36.633218 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Identity-Status: Confirmed May 26 15:20:36.633218 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Is-Admin-Project: True May 26 15:20:36.633218 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Id: default May 26 15:20:36.633218 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Name: Default May 26 15:20:36.633218 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Id: 1da6b127a0d64f8892c4935ef08ed679 May 26 15:20:36.633218 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Name: tempest-TestVolumeBootPattern-1530978248 May 26 15:20:36.633218 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Role: reader,member May 26 15:20:36.633218 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Roles: reader,member May 26 15:20:36.634831 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1da6b127a0d64f8892c4935ef08ed679"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1da6b127a0d64f8892c4935ef08ed679"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1da6b127a0d64f8892c4935ef08ed679"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1da6b127a0d64f8892c4935ef08ed679"}]}] May 26 15:20:36.634831 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant: tempest-TestVolumeBootPattern-1530978248 May 26 15:20:36.634831 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Id: 1da6b127a0d64f8892c4935ef08ed679 May 26 15:20:36.634831 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Name: tempest-TestVolumeBootPattern-1530978248 May 26 15:20:36.634831 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User: tempest-TestVolumeBootPattern-1530978248-project May 26 15:20:36.634831 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Id: default May 26 15:20:36.634831 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Name: Default May 26 15:20:36.634831 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Id: e55884035fd3441583ece37dd8eb9248 May 26 15:20:36.634831 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Name: tempest-TestVolumeBootPattern-1530978248-project May 26 15:20:36.634831 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: method: > May 26 15:20:36.634831 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: exception: Instance 612ae9ec-d528-4264-afd3-373c904f50fd could not be found. May 26 15:20:36.634831 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: action_args: {'id': '612ae9ec-d528-4264-afd3-373c904f50fd'} May 26 15:20:36.635791 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:20:36.635791 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:20:36.635791 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:20:36.635791 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:20:36.635791 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:20:36.635791 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:20:36.635791 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:20:36.635791 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:20:36.635791 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:20:36.635791 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:20:36.635791 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 612ae9ec-d528-4264-afd3-373c904f50fd could not be found. May 26 15:20:36.635791 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:20:36.635791 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:20:36.635791 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:20:36.635791 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:20:36.635791 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:20:36.635791 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:20:36.635791 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:20:36.635791 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:20:36.635791 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:20:36.637261 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:20:36.637261 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:20:36.637261 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:20:36.637261 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:20:36.637261 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:20:36.637261 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:20:36.637261 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:20:36.637261 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 612ae9ec-d528-4264-afd3-373c904f50fd could not be found. May 26 15:20:36.637261 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:20:36.637261 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:20:36.637261 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:20:36.637261 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:20:36.637261 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:20:36.637261 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:20:36.637261 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:20:36.637261 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:20:36.637261 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 612ae9ec-d528-4264-afd3-373c904f50fd could not be found. May 26 15:20:36.637261 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:20:36.638521 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-a892a0d2-0323-4c39-ae96-45b412b4da42 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Returning 404 to user: Instance 612ae9ec-d528-4264-afd3-373c904f50fd could not be found. {{(pid=117799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:20:36.638521 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-a892a0d2-0323-4c39-ae96-45b412b4da42 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd" status: 404 len: 111 microversion: 2.1 time: 0.030696 May 26 15:20:36.638521 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 479/929] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:20:36 2022] GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 15:20:36.792254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-3534674e-5b61-4566-8b46-d6656fd9f0fd tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-242545073", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1181214903", "security_groups": [{"name": "tempest-secgroup-smoke-986633093"}], "block_device_mapping_v2": [{"uuid": "3f27f095-f4f7-479d-bcd1-ee32dfea7d7f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "38936b65-04c9-4d68-a6df-607fd923b2aa"}]}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:20:36.957063 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.network.neutron [None req-3534674e-5b61-4566-8b46-d6656fd9f0fd tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] validate_networks() for [('38936b65-04c9-4d68-a6df-607fd923b2aa', None, None, None, None, None)] {{(pid=117798) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:20:37.660564 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-3534674e-5b61-4566-8b46-d6656fd9f0fd tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Flavor limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:20:37.661185 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-3534674e-5b61-4566-8b46-d6656fd9f0fd tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Image limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:20:37.661605 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-3534674e-5b61-4566-8b46-d6656fd9f0fd tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Flavor pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:20:37.662019 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-3534674e-5b61-4566-8b46-d6656fd9f0fd tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Image pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:20:37.662466 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-3534674e-5b61-4566-8b46-d6656fd9f0fd tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:20:37.671440 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3534674e-5b61-4566-8b46-d6656fd9f0fd tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:37.671831 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3534674e-5b61-4566-8b46-d6656fd9f0fd tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:37.672630 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3534674e-5b61-4566-8b46-d6656fd9f0fd tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:37.673075 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3534674e-5b61-4566-8b46-d6656fd9f0fd tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:37.690887 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-3534674e-5b61-4566-8b46-d6656fd9f0fd tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Getting quotas for project 1da6b127a0d64f8892c4935ef08ed679. Resources: {'cores', 'ram', 'instances'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:20:37.695077 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-3534674e-5b61-4566-8b46-d6656fd9f0fd tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Getting quotas for user e55884035fd3441583ece37dd8eb9248 and project 1da6b127a0d64f8892c4935ef08ed679. Resources: {'cores', 'ram', 'instances'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:20:37.761222 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-3534674e-5b61-4566-8b46-d6656fd9f0fd tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Going to run 1 instances... {{(pid=117798) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:20:37.763565 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-3534674e-5b61-4566-8b46-d6656fd9f0fd tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 415bda6c-cdab-45fa-adfe-590484a01588] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3f27f095-f4f7-479d-bcd1-ee32dfea7d7f',volume_size=None,volume_type=None)] {{(pid=117798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:20:37.913752 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-3534674e-5b61-4566-8b46-d6656fd9f0fd tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.125463 May 26 15:20:37.916726 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 451/930] 10.222.0.45 () {60 vars in 1146 bytes} [Thu May 26 15:20:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 1129 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 15:20:37.927274 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-96178420-5c6c-4fef-86a8-fe21c1a30182 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:37.928565 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-96178420-5c6c-4fef-86a8-fe21c1a30182 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 415bda6c-cdab-45fa-adfe-590484a01588] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:37.993496 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-96178420-5c6c-4fef-86a8-fe21c1a30182 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:38.001191 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-96178420-5c6c-4fef-86a8-fe21c1a30182 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588" status: 200 len: 1094 microversion: 2.1 time: 0.077920 May 26 15:20:38.001703 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 480/931] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:20:37 2022] GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588 => generated 1094 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:20:39.019710 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-38ccc71c-1fe8-4c06-9eb1-6c2658740ac9 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:39.020329 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-38ccc71c-1fe8-4c06-9eb1-6c2658740ac9 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 415bda6c-cdab-45fa-adfe-590484a01588] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:39.028293 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-38ccc71c-1fe8-4c06-9eb1-6c2658740ac9 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:39.028837 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-38ccc71c-1fe8-4c06-9eb1-6c2658740ac9 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:39.029708 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-38ccc71c-1fe8-4c06-9eb1-6c2658740ac9 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:39.030054 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-38ccc71c-1fe8-4c06-9eb1-6c2658740ac9 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:39.105247 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-38ccc71c-1fe8-4c06-9eb1-6c2658740ac9 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:39.113899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-38ccc71c-1fe8-4c06-9eb1-6c2658740ac9 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588" status: 200 len: 1144 microversion: 2.1 time: 0.099399 May 26 15:20:39.114820 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 452/932] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:20:39 2022] GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588 => generated 1144 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:20:40.132149 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-9f02e17f-b122-46d1-a0ed-e40575db4bb3 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:40.133649 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-9f02e17f-b122-46d1-a0ed-e40575db4bb3 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 415bda6c-cdab-45fa-adfe-590484a01588] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:40.144769 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9f02e17f-b122-46d1-a0ed-e40575db4bb3 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:40.146382 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9f02e17f-b122-46d1-a0ed-e40575db4bb3 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:40.147595 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9f02e17f-b122-46d1-a0ed-e40575db4bb3 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:40.148517 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9f02e17f-b122-46d1-a0ed-e40575db4bb3 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:40.227686 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-9f02e17f-b122-46d1-a0ed-e40575db4bb3 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:40.235503 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-9f02e17f-b122-46d1-a0ed-e40575db4bb3 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588" status: 200 len: 1210 microversion: 2.1 time: 0.107441 May 26 15:20:40.236074 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 481/933] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:20:40 2022] GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588 => generated 1210 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:20:41.257394 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c193e00f-5b00-45f5-b505-c51f46e832b7 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:41.259858 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c193e00f-5b00-45f5-b505-c51f46e832b7 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 415bda6c-cdab-45fa-adfe-590484a01588] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:41.275420 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c193e00f-5b00-45f5-b505-c51f46e832b7 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:41.275851 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c193e00f-5b00-45f5-b505-c51f46e832b7 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:41.276779 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c193e00f-5b00-45f5-b505-c51f46e832b7 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:41.277445 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c193e00f-5b00-45f5-b505-c51f46e832b7 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:41.451504 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c193e00f-5b00-45f5-b505-c51f46e832b7 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:41.471652 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c193e00f-5b00-45f5-b505-c51f46e832b7 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588" status: 200 len: 1265 microversion: 2.1 time: 0.217332 May 26 15:20:41.474046 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 453/934] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:20:41 2022] GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588 => generated 1265 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:20:41.611669 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-12c34b62-17c1-485c-92f1-a2d399665407 req-5028eb66-6c25-4257-b4cc-b1bad6fad9d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "415bda6c-cdab-45fa-adfe-590484a01588", "tag": "034c4c8a-2f6d-4111-819f-f099fea94828"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:20:41.632203 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-12c34b62-17c1-485c-92f1-a2d399665407 req-5028eb66-6c25-4257-b4cc-b1bad6fad9d3 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:41.642324 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-12c34b62-17c1-485c-92f1-a2d399665407 req-5028eb66-6c25-4257-b4cc-b1bad6fad9d3 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:41.677718 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-12c34b62-17c1-485c-92f1-a2d399665407 req-5028eb66-6c25-4257-b4cc-b1bad6fad9d3 service nova] Creating event network-changed:034c4c8a-2f6d-4111-819f-f099fea94828 for instance 415bda6c-cdab-45fa-adfe-590484a01588 on hv-cinder-84301 May 26 15:20:41.688890 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-12c34b62-17c1-485c-92f1-a2d399665407 req-5028eb66-6c25-4257-b4cc-b1bad6fad9d3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080937 May 26 15:20:41.694595 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 482/935] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:20:42.490930 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-6f5707e8-fc43-42d8-8440-931e870c7bcd tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:42.491618 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-6f5707e8-fc43-42d8-8440-931e870c7bcd tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 415bda6c-cdab-45fa-adfe-590484a01588] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:42.498574 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6f5707e8-fc43-42d8-8440-931e870c7bcd tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:42.499078 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6f5707e8-fc43-42d8-8440-931e870c7bcd tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:42.500483 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6f5707e8-fc43-42d8-8440-931e870c7bcd tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:42.500917 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6f5707e8-fc43-42d8-8440-931e870c7bcd tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:42.652945 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6f5707e8-fc43-42d8-8440-931e870c7bcd tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:42.660586 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-6f5707e8-fc43-42d8-8440-931e870c7bcd tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588" status: 200 len: 1265 microversion: 2.1 time: 0.173971 May 26 15:20:42.661155 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 454/936] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:20:42 2022] GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:20:43.678231 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-ac1c70a7-af87-4cae-94ce-8c19a916efb4 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:43.678931 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-ac1c70a7-af87-4cae-94ce-8c19a916efb4 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 415bda6c-cdab-45fa-adfe-590484a01588] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:43.685194 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ac1c70a7-af87-4cae-94ce-8c19a916efb4 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:43.685644 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ac1c70a7-af87-4cae-94ce-8c19a916efb4 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:43.686415 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ac1c70a7-af87-4cae-94ce-8c19a916efb4 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:43.687501 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ac1c70a7-af87-4cae-94ce-8c19a916efb4 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:43.817905 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-ac1c70a7-af87-4cae-94ce-8c19a916efb4 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:43.825635 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-ac1c70a7-af87-4cae-94ce-8c19a916efb4 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588" status: 200 len: 1265 microversion: 2.1 time: 0.152188 May 26 15:20:43.826274 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 483/937] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:20:43 2022] GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:20:44.843844 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f53811bc-6884-4fa2-9b45-24b33d2e2729 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:44.844517 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f53811bc-6884-4fa2-9b45-24b33d2e2729 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 415bda6c-cdab-45fa-adfe-590484a01588] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:44.851072 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f53811bc-6884-4fa2-9b45-24b33d2e2729 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:44.851553 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f53811bc-6884-4fa2-9b45-24b33d2e2729 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:44.852320 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f53811bc-6884-4fa2-9b45-24b33d2e2729 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:44.852759 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f53811bc-6884-4fa2-9b45-24b33d2e2729 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:44.982858 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f53811bc-6884-4fa2-9b45-24b33d2e2729 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:44.990503 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f53811bc-6884-4fa2-9b45-24b33d2e2729 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588" status: 200 len: 1265 microversion: 2.1 time: 0.151276 May 26 15:20:44.991071 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 455/938] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:20:44 2022] GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:20:46.007909 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-dd774973-92a0-49a1-a6ce-74e337113b89 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:46.008435 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-dd774973-92a0-49a1-a6ce-74e337113b89 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 415bda6c-cdab-45fa-adfe-590484a01588] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:46.014967 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dd774973-92a0-49a1-a6ce-74e337113b89 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:46.015460 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dd774973-92a0-49a1-a6ce-74e337113b89 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:46.016504 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dd774973-92a0-49a1-a6ce-74e337113b89 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:46.016938 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dd774973-92a0-49a1-a6ce-74e337113b89 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:46.171241 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-dd774973-92a0-49a1-a6ce-74e337113b89 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:46.177397 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-dd774973-92a0-49a1-a6ce-74e337113b89 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588" status: 200 len: 1265 microversion: 2.1 time: 0.173447 May 26 15:20:46.177964 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 484/939] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:20:46 2022] GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:20:47.194039 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-dda41f5b-193c-4070-bb67-da172f19ed25 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:47.194644 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-dda41f5b-193c-4070-bb67-da172f19ed25 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 415bda6c-cdab-45fa-adfe-590484a01588] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:47.197103 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:47.203855 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dda41f5b-193c-4070-bb67-da172f19ed25 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:47.204326 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dda41f5b-193c-4070-bb67-da172f19ed25 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:47.205082 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dda41f5b-193c-4070-bb67-da172f19ed25 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:47.205507 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dda41f5b-193c-4070-bb67-da172f19ed25 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:47.208668 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:47.340124 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-dda41f5b-193c-4070-bb67-da172f19ed25 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:47.348668 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-dda41f5b-193c-4070-bb67-da172f19ed25 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588" status: 200 len: 1265 microversion: 2.1 time: 0.158470 May 26 15:20:47.349222 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 456/940] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:20:47 2022] GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:20:48.365755 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-ac59a27c-d728-4f04-a80d-8ab26b5d000e tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:48.366345 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-ac59a27c-d728-4f04-a80d-8ab26b5d000e tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 415bda6c-cdab-45fa-adfe-590484a01588] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:48.368730 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell0:SELECT=2 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:48.369364 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=2 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:48.375562 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ac59a27c-d728-4f04-a80d-8ab26b5d000e tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:48.376007 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ac59a27c-d728-4f04-a80d-8ab26b5d000e tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:48.376767 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ac59a27c-d728-4f04-a80d-8ab26b5d000e tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:48.377199 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ac59a27c-d728-4f04-a80d-8ab26b5d000e tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:48.380459 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:48.510369 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-ac59a27c-d728-4f04-a80d-8ab26b5d000e tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:48.519286 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-ac59a27c-d728-4f04-a80d-8ab26b5d000e tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588" status: 200 len: 1265 microversion: 2.1 time: 0.157276 May 26 15:20:48.519854 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 485/941] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:20:48 2022] GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:20:49.536755 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-5e91d2be-4c77-415a-87fb-3a7bfa1f863c tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:49.537360 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-5e91d2be-4c77-415a-87fb-3a7bfa1f863c tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 415bda6c-cdab-45fa-adfe-590484a01588] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:49.539248 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=2 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:49.539897 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=6 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:49.548086 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5e91d2be-4c77-415a-87fb-3a7bfa1f863c tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:49.548529 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5e91d2be-4c77-415a-87fb-3a7bfa1f863c tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:49.549286 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5e91d2be-4c77-415a-87fb-3a7bfa1f863c tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:49.549717 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5e91d2be-4c77-415a-87fb-3a7bfa1f863c tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:49.689816 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-5e91d2be-4c77-415a-87fb-3a7bfa1f863c tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:49.697424 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-5e91d2be-4c77-415a-87fb-3a7bfa1f863c tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588" status: 200 len: 1265 microversion: 2.1 time: 0.164599 May 26 15:20:49.697999 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 457/942] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:20:49 2022] GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:20:50.714701 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-b7ca38e0-961b-4f14-a0e8-8bca5498aedf tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:50.715333 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-b7ca38e0-961b-4f14-a0e8-8bca5498aedf tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 415bda6c-cdab-45fa-adfe-590484a01588] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:50.722324 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b7ca38e0-961b-4f14-a0e8-8bca5498aedf tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:50.722768 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b7ca38e0-961b-4f14-a0e8-8bca5498aedf tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:50.723559 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b7ca38e0-961b-4f14-a0e8-8bca5498aedf tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:50.723992 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b7ca38e0-961b-4f14-a0e8-8bca5498aedf tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:50.860913 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-b7ca38e0-961b-4f14-a0e8-8bca5498aedf tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:50.868381 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-b7ca38e0-961b-4f14-a0e8-8bca5498aedf tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588" status: 200 len: 1265 microversion: 2.1 time: 0.157503 May 26 15:20:50.868946 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 486/943] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:20:50 2022] GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:20:51.885715 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-fdae151c-9ce4-4dc2-a20f-88e03fcea593 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:51.886311 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-fdae151c-9ce4-4dc2-a20f-88e03fcea593 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 415bda6c-cdab-45fa-adfe-590484a01588] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:51.893892 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fdae151c-9ce4-4dc2-a20f-88e03fcea593 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:51.894328 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fdae151c-9ce4-4dc2-a20f-88e03fcea593 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:51.895128 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fdae151c-9ce4-4dc2-a20f-88e03fcea593 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:51.895534 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fdae151c-9ce4-4dc2-a20f-88e03fcea593 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:52.036902 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-fdae151c-9ce4-4dc2-a20f-88e03fcea593 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:52.044853 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-fdae151c-9ce4-4dc2-a20f-88e03fcea593 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588" status: 200 len: 1265 microversion: 2.1 time: 0.162963 May 26 15:20:52.045418 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 458/944] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:20:51 2022] GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:20:53.061608 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-5bc5f538-b03a-4838-ac6f-74532289971e tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:53.062238 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-5bc5f538-b03a-4838-ac6f-74532289971e tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 415bda6c-cdab-45fa-adfe-590484a01588] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:53.069123 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5bc5f538-b03a-4838-ac6f-74532289971e tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:53.069574 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5bc5f538-b03a-4838-ac6f-74532289971e tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:53.070341 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5bc5f538-b03a-4838-ac6f-74532289971e tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:53.070781 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5bc5f538-b03a-4838-ac6f-74532289971e tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:53.205687 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-5bc5f538-b03a-4838-ac6f-74532289971e tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:53.214665 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-5bc5f538-b03a-4838-ac6f-74532289971e tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588" status: 200 len: 1265 microversion: 2.1 time: 0.157042 May 26 15:20:53.215264 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 487/945] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:20:53 2022] GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:20:54.232544 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-460012b2-8a5b-4c12-adf0-169903112faa tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:54.233142 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-460012b2-8a5b-4c12-adf0-169903112faa tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 415bda6c-cdab-45fa-adfe-590484a01588] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:54.239822 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-460012b2-8a5b-4c12-adf0-169903112faa tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:54.240271 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-460012b2-8a5b-4c12-adf0-169903112faa tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:54.241078 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-460012b2-8a5b-4c12-adf0-169903112faa tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:54.241512 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-460012b2-8a5b-4c12-adf0-169903112faa tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:54.372206 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-460012b2-8a5b-4c12-adf0-169903112faa tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:54.380388 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-460012b2-8a5b-4c12-adf0-169903112faa tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588" status: 200 len: 1265 microversion: 2.1 time: 0.151782 May 26 15:20:54.380973 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 459/946] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:20:54 2022] GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:20:55.397465 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-5fd04315-4951-4d9d-86df-94cc3b58443c tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:55.397995 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-5fd04315-4951-4d9d-86df-94cc3b58443c tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 415bda6c-cdab-45fa-adfe-590484a01588] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:55.404451 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5fd04315-4951-4d9d-86df-94cc3b58443c tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:55.404891 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5fd04315-4951-4d9d-86df-94cc3b58443c tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:55.406156 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5fd04315-4951-4d9d-86df-94cc3b58443c tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:55.406586 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5fd04315-4951-4d9d-86df-94cc3b58443c tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:55.539005 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-5fd04315-4951-4d9d-86df-94cc3b58443c tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:55.547114 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-5fd04315-4951-4d9d-86df-94cc3b58443c tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588" status: 200 len: 1265 microversion: 2.1 time: 0.153568 May 26 15:20:55.547689 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 488/947] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:20:55 2022] GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:20:56.563819 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-bc01ef0e-76eb-441f-9b5f-6efde429d3d9 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:56.564360 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-bc01ef0e-76eb-441f-9b5f-6efde429d3d9 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 415bda6c-cdab-45fa-adfe-590484a01588] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:56.570826 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bc01ef0e-76eb-441f-9b5f-6efde429d3d9 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:56.571312 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bc01ef0e-76eb-441f-9b5f-6efde429d3d9 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:56.572079 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bc01ef0e-76eb-441f-9b5f-6efde429d3d9 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:56.572518 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bc01ef0e-76eb-441f-9b5f-6efde429d3d9 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:56.706048 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-bc01ef0e-76eb-441f-9b5f-6efde429d3d9 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:56.713663 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-bc01ef0e-76eb-441f-9b5f-6efde429d3d9 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588" status: 200 len: 1265 microversion: 2.1 time: 0.153858 May 26 15:20:56.714221 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 460/948] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:20:56 2022] GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:20:57.730380 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-a6ed61fa-8f73-42b0-ba90-e2fa0fd5a442 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:57.730996 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-a6ed61fa-8f73-42b0-ba90-e2fa0fd5a442 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 415bda6c-cdab-45fa-adfe-590484a01588] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:57.737457 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a6ed61fa-8f73-42b0-ba90-e2fa0fd5a442 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:57.737918 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a6ed61fa-8f73-42b0-ba90-e2fa0fd5a442 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:57.738699 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a6ed61fa-8f73-42b0-ba90-e2fa0fd5a442 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:57.739172 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a6ed61fa-8f73-42b0-ba90-e2fa0fd5a442 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:57.875954 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-a6ed61fa-8f73-42b0-ba90-e2fa0fd5a442 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:57.883780 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-a6ed61fa-8f73-42b0-ba90-e2fa0fd5a442 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588" status: 200 len: 1265 microversion: 2.1 time: 0.157298 May 26 15:20:57.884424 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 489/949] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:20:57 2022] GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:20:58.900917 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-31f13084-7f78-4000-9c65-e9450f598c45 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:58.901522 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-31f13084-7f78-4000-9c65-e9450f598c45 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 415bda6c-cdab-45fa-adfe-590484a01588] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:58.908717 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-31f13084-7f78-4000-9c65-e9450f598c45 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:58.909159 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-31f13084-7f78-4000-9c65-e9450f598c45 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:58.909914 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-31f13084-7f78-4000-9c65-e9450f598c45 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:58.910343 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-31f13084-7f78-4000-9c65-e9450f598c45 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:59.052303 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-31f13084-7f78-4000-9c65-e9450f598c45 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:59.060702 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-31f13084-7f78-4000-9c65-e9450f598c45 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588" status: 200 len: 1265 microversion: 2.1 time: 0.163519 May 26 15:20:59.061632 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 461/950] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:20:58 2022] GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:20:59.816376 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-cfb87cee-0a8b-48b0-959f-a67ea347bc11 req-10ecc846-977d-4aa7-9994-0cf590ca9111 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "415bda6c-cdab-45fa-adfe-590484a01588", "name": "network-vif-plugged", "status": "completed", "tag": "034c4c8a-2f6d-4111-819f-f099fea94828"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:20:59.824321 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-cfb87cee-0a8b-48b0-959f-a67ea347bc11 req-10ecc846-977d-4aa7-9994-0cf590ca9111 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:59.824761 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-cfb87cee-0a8b-48b0-959f-a67ea347bc11 req-10ecc846-977d-4aa7-9994-0cf590ca9111 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:59.835868 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-cfb87cee-0a8b-48b0-959f-a67ea347bc11 req-10ecc846-977d-4aa7-9994-0cf590ca9111 service nova] Creating event network-vif-plugged:034c4c8a-2f6d-4111-819f-f099fea94828 for instance 415bda6c-cdab-45fa-adfe-590484a01588 on hv-cinder-84301 May 26 15:20:59.841069 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-cfb87cee-0a8b-48b0-959f-a67ea347bc11 req-10ecc846-977d-4aa7-9994-0cf590ca9111 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159464 May 26 15:20:59.841681 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 490/951] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:21:00.077765 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e38122a6-05c5-434b-b179-3969f68ff808 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:21:00.078373 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e38122a6-05c5-434b-b179-3969f68ff808 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 415bda6c-cdab-45fa-adfe-590484a01588] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:21:00.084969 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e38122a6-05c5-434b-b179-3969f68ff808 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:00.085412 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e38122a6-05c5-434b-b179-3969f68ff808 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:00.086176 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e38122a6-05c5-434b-b179-3969f68ff808 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:00.086609 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e38122a6-05c5-434b-b179-3969f68ff808 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:00.220275 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e38122a6-05c5-434b-b179-3969f68ff808 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:21:00.227986 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e38122a6-05c5-434b-b179-3969f68ff808 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588" status: 200 len: 1265 microversion: 2.1 time: 0.154169 May 26 15:21:00.228561 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 462/952] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:21:00 2022] GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:21:01.246639 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-b6ea57d6-4f6f-4848-807c-7261696c3248 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:21:01.247364 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-b6ea57d6-4f6f-4848-807c-7261696c3248 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 415bda6c-cdab-45fa-adfe-590484a01588] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:21:01.255011 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b6ea57d6-4f6f-4848-807c-7261696c3248 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:01.255497 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b6ea57d6-4f6f-4848-807c-7261696c3248 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:01.256268 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b6ea57d6-4f6f-4848-807c-7261696c3248 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:01.256707 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b6ea57d6-4f6f-4848-807c-7261696c3248 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:01.391234 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-b6ea57d6-4f6f-4848-807c-7261696c3248 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:21:01.398917 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-b6ea57d6-4f6f-4848-807c-7261696c3248 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588" status: 200 len: 1265 microversion: 2.1 time: 0.156926 May 26 15:21:01.399531 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 491/953] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:21:01 2022] GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:21:02.416144 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1150185d-2f06-4c3e-a7f7-45eddf379254 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:21:02.416744 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1150185d-2f06-4c3e-a7f7-45eddf379254 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 415bda6c-cdab-45fa-adfe-590484a01588] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:21:02.423765 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1150185d-2f06-4c3e-a7f7-45eddf379254 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:02.424218 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1150185d-2f06-4c3e-a7f7-45eddf379254 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:02.424987 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1150185d-2f06-4c3e-a7f7-45eddf379254 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:02.425424 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1150185d-2f06-4c3e-a7f7-45eddf379254 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:02.558897 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1150185d-2f06-4c3e-a7f7-45eddf379254 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:21:02.567174 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1150185d-2f06-4c3e-a7f7-45eddf379254 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588" status: 200 len: 1265 microversion: 2.1 time: 0.154973 May 26 15:21:02.567747 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 463/954] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:21:02 2022] GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:21:03.583810 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-5917a16a-4065-4279-86e3-f9898fcb1934 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:21:03.584422 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-5917a16a-4065-4279-86e3-f9898fcb1934 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 415bda6c-cdab-45fa-adfe-590484a01588] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:21:03.590879 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5917a16a-4065-4279-86e3-f9898fcb1934 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:03.591356 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5917a16a-4065-4279-86e3-f9898fcb1934 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:03.592117 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5917a16a-4065-4279-86e3-f9898fcb1934 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:03.592550 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5917a16a-4065-4279-86e3-f9898fcb1934 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:03.728710 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-5917a16a-4065-4279-86e3-f9898fcb1934 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:21:03.736827 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-5917a16a-4065-4279-86e3-f9898fcb1934 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588" status: 200 len: 1265 microversion: 2.1 time: 0.156966 May 26 15:21:03.737373 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 492/955] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:21:03 2022] GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:21:04.754050 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-8d5ff188-b6c0-4f7d-835e-d17b8e75b6ec tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:21:04.754597 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-8d5ff188-b6c0-4f7d-835e-d17b8e75b6ec tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 415bda6c-cdab-45fa-adfe-590484a01588] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:21:04.761251 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8d5ff188-b6c0-4f7d-835e-d17b8e75b6ec tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:04.761701 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8d5ff188-b6c0-4f7d-835e-d17b8e75b6ec tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:04.762466 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8d5ff188-b6c0-4f7d-835e-d17b8e75b6ec tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:04.762902 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8d5ff188-b6c0-4f7d-835e-d17b8e75b6ec tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:04.894357 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-8d5ff188-b6c0-4f7d-835e-d17b8e75b6ec tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:21:04.902102 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-8d5ff188-b6c0-4f7d-835e-d17b8e75b6ec tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588" status: 200 len: 1265 microversion: 2.1 time: 0.152044 May 26 15:21:04.902919 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 464/956] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:21:04 2022] GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:21:05.919512 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-79cd6109-ef05-462b-ace4-165bba5b9432 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:21:05.920146 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-79cd6109-ef05-462b-ace4-165bba5b9432 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 415bda6c-cdab-45fa-adfe-590484a01588] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:21:05.927582 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-79cd6109-ef05-462b-ace4-165bba5b9432 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:05.928038 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-79cd6109-ef05-462b-ace4-165bba5b9432 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:05.928843 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-79cd6109-ef05-462b-ace4-165bba5b9432 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:05.929289 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-79cd6109-ef05-462b-ace4-165bba5b9432 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:06.061668 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-79cd6109-ef05-462b-ace4-165bba5b9432 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:21:06.069234 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-79cd6109-ef05-462b-ace4-165bba5b9432 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588" status: 200 len: 1453 microversion: 2.1 time: 0.154162 May 26 15:21:06.069803 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 493/957] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:21:05 2022] GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:21:06.084723 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b12a07f2-e431-439d-8c91-d40959df14c0 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:21:06.085332 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b12a07f2-e431-439d-8c91-d40959df14c0 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 415bda6c-cdab-45fa-adfe-590484a01588] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:21:06.092158 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b12a07f2-e431-439d-8c91-d40959df14c0 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:06.092960 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b12a07f2-e431-439d-8c91-d40959df14c0 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:06.093392 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b12a07f2-e431-439d-8c91-d40959df14c0 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:06.093826 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b12a07f2-e431-439d-8c91-d40959df14c0 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:06.236296 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b12a07f2-e431-439d-8c91-d40959df14c0 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:21:06.244067 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b12a07f2-e431-439d-8c91-d40959df14c0 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588" status: 200 len: 1453 microversion: 2.1 time: 0.163099 May 26 15:21:06.244924 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 465/958] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:21:06 2022] GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588 => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:21:08.111218 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-08d5b0dd-4d0e-4032-ba99-1d3aea32451e req-cf84e98d-fd20-40a1-b000-06a813dd8dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "415bda6c-cdab-45fa-adfe-590484a01588", "tag": "034c4c8a-2f6d-4111-819f-f099fea94828"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:21:08.119568 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-08d5b0dd-4d0e-4032-ba99-1d3aea32451e req-cf84e98d-fd20-40a1-b000-06a813dd8dc2 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:08.120011 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-08d5b0dd-4d0e-4032-ba99-1d3aea32451e req-cf84e98d-fd20-40a1-b000-06a813dd8dc2 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:08.132001 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-08d5b0dd-4d0e-4032-ba99-1d3aea32451e req-cf84e98d-fd20-40a1-b000-06a813dd8dc2 service nova] Creating event network-changed:034c4c8a-2f6d-4111-819f-f099fea94828 for instance 415bda6c-cdab-45fa-adfe-590484a01588 on hv-cinder-84301 May 26 15:21:08.137381 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-08d5b0dd-4d0e-4032-ba99-1d3aea32451e req-cf84e98d-fd20-40a1-b000-06a813dd8dc2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030279 May 26 15:21:08.138216 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 494/959] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:21:16.097254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-89866a17-5eb6-47b7-bbd4-e174ca414e5d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:21:16.098235 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-89866a17-5eb6-47b7-bbd4-e174ca414e5d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:21:16.100421 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=19 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:16.105696 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-89866a17-5eb6-47b7-bbd4-e174ca414e5d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:16.106140 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-89866a17-5eb6-47b7-bbd4-e174ca414e5d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:16.106897 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-89866a17-5eb6-47b7-bbd4-e174ca414e5d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:16.107360 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-89866a17-5eb6-47b7-bbd4-e174ca414e5d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:16.136047 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-89866a17-5eb6-47b7-bbd4-e174ca414e5d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042820 May 26 15:21:16.136604 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 466/960] 10.222.0.45 () {60 vars in 1342 bytes} [Thu May 26 15:21:16 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:21:16.195228 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-010e956d-a9ff-4a51-8219-c3374d2ebcfa tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:21:16.195851 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-010e956d-a9ff-4a51-8219-c3374d2ebcfa tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:21:16.203287 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-010e956d-a9ff-4a51-8219-c3374d2ebcfa tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:16.203763 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-010e956d-a9ff-4a51-8219-c3374d2ebcfa tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:16.204540 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-010e956d-a9ff-4a51-8219-c3374d2ebcfa tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:16.204974 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-010e956d-a9ff-4a51-8219-c3374d2ebcfa tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:16.230843 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-010e956d-a9ff-4a51-8219-c3374d2ebcfa tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Going to try to terminate instance {{(pid=117799) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:21:16.306345 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-010e956d-a9ff-4a51-8219-c3374d2ebcfa tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 204 len: 0 microversion: 2.20 time: 0.115658 May 26 15:21:16.307030 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 495/961] 10.222.0.45 () {60 vars in 1279 bytes} [Thu May 26 15:21:16 2022] DELETE /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 15:21:16.315606 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-6d3af633-f26a-4e50-80bf-0e4088c3994d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:21:16.316217 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-6d3af633-f26a-4e50-80bf-0e4088c3994d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:21:16.322148 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6d3af633-f26a-4e50-80bf-0e4088c3994d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:16.322597 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6d3af633-f26a-4e50-80bf-0e4088c3994d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:16.323408 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6d3af633-f26a-4e50-80bf-0e4088c3994d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:16.323845 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6d3af633-f26a-4e50-80bf-0e4088c3994d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:16.454747 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6d3af633-f26a-4e50-80bf-0e4088c3994d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:21:16.462636 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6d3af633-f26a-4e50-80bf-0e4088c3994d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:21:16.464179 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6d3af633-f26a-4e50-80bf-0e4088c3994d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:21:16.465345 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-6d3af633-f26a-4e50-80bf-0e4088c3994d tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1725 microversion: 2.20 time: 0.153801 May 26 15:21:16.465910 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 467/962] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:21:16 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:21:17.485006 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-4744dd98-f160-43ff-aac9-597736ebd529 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:21:17.485711 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-4744dd98-f160-43ff-aac9-597736ebd529 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:21:17.492300 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4744dd98-f160-43ff-aac9-597736ebd529 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:17.492753 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4744dd98-f160-43ff-aac9-597736ebd529 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:17.493530 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4744dd98-f160-43ff-aac9-597736ebd529 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:17.493971 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4744dd98-f160-43ff-aac9-597736ebd529 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:17.892406 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-4744dd98-f160-43ff-aac9-597736ebd529 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:21:17.900510 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-4744dd98-f160-43ff-aac9-597736ebd529 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:21:17.902041 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-4744dd98-f160-43ff-aac9-597736ebd529 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:21:17.903287 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-4744dd98-f160-43ff-aac9-597736ebd529 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1725 microversion: 2.20 time: 0.423107 May 26 15:21:17.903847 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 496/963] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:21:17 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1725 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:21:18.923784 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-81119a38-62ca-44a1-a548-b310d62f588e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:21:18.924393 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-81119a38-62ca-44a1-a548-b310d62f588e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:21:18.931409 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-81119a38-62ca-44a1-a548-b310d62f588e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:18.932082 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-81119a38-62ca-44a1-a548-b310d62f588e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:18.932860 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-81119a38-62ca-44a1-a548-b310d62f588e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:18.933290 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-81119a38-62ca-44a1-a548-b310d62f588e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:18.937521 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=72 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:19.088038 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-81119a38-62ca-44a1-a548-b310d62f588e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:21:19.099267 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-81119a38-62ca-44a1-a548-b310d62f588e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:21:19.100908 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-81119a38-62ca-44a1-a548-b310d62f588e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:21:19.102103 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-81119a38-62ca-44a1-a548-b310d62f588e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1725 microversion: 2.20 time: 0.183054 May 26 15:21:19.107614 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 468/964] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:21:18 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1725 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:21:19.450968 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-15595d1b-2888-40e4-9fe9-871bd3b08ecb req-7cd1c927-7de8-47d0-9038-77f17055d9e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d97e6323-aeef-4755-9bc5-93ae5140640b", "name": "network-vif-deleted", "tag": "88cc91ef-0c85-4971-928d-0eb2739f6222"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:21:19.458306 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:19.465879 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-15595d1b-2888-40e4-9fe9-871bd3b08ecb req-7cd1c927-7de8-47d0-9038-77f17055d9e4 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:19.466614 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-15595d1b-2888-40e4-9fe9-871bd3b08ecb req-7cd1c927-7de8-47d0-9038-77f17055d9e4 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:19.479109 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:19.481638 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-15595d1b-2888-40e4-9fe9-871bd3b08ecb req-7cd1c927-7de8-47d0-9038-77f17055d9e4 service nova] Creating event network-vif-deleted:88cc91ef-0c85-4971-928d-0eb2739f6222 for instance d97e6323-aeef-4755-9bc5-93ae5140640b on hv-cinder-84301 May 26 15:21:19.487347 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-15595d1b-2888-40e4-9fe9-871bd3b08ecb req-7cd1c927-7de8-47d0-9038-77f17055d9e4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040527 May 26 15:21:19.488492 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 497/965] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:21:20.122446 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-6c76c284-a2e4-46a6-a750-846e01c16e57 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:21:20.124183 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-6c76c284-a2e4-46a6-a750-846e01c16e57 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:21:20.131330 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6c76c284-a2e4-46a6-a750-846e01c16e57 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:20.131781 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6c76c284-a2e4-46a6-a750-846e01c16e57 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:20.132562 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6c76c284-a2e4-46a6-a750-846e01c16e57 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:20.133212 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6c76c284-a2e4-46a6-a750-846e01c16e57 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:20.165583 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6c76c284-a2e4-46a6-a750-846e01c16e57 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:20.166033 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6c76c284-a2e4-46a6-a750-846e01c16e57 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:20.166485 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.objects.instance [None req-6c76c284-a2e4-46a6-a750-846e01c16e57 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lazy-loading 'fault' on Instance uuid d97e6323-aeef-4755-9bc5-93ae5140640b {{(pid=117798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:21:20.209703 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6c76c284-a2e4-46a6-a750-846e01c16e57 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:21:20.217980 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6c76c284-a2e4-46a6-a750-846e01c16e57 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:21:20.219509 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6c76c284-a2e4-46a6-a750-846e01c16e57 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:21:20.220702 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-6c76c284-a2e4-46a6-a750-846e01c16e57 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1371 microversion: 2.20 time: 0.103655 May 26 15:21:20.221261 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 469/966] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:21:20 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:21:21.239945 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-8433474e-0f2a-47e2-b978-01115f53c31e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:21:21.240631 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-8433474e-0f2a-47e2-b978-01115f53c31e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:21:21.247719 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8433474e-0f2a-47e2-b978-01115f53c31e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:21.248656 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8433474e-0f2a-47e2-b978-01115f53c31e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:21.249903 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8433474e-0f2a-47e2-b978-01115f53c31e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:21.250332 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8433474e-0f2a-47e2-b978-01115f53c31e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:21.284673 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8433474e-0f2a-47e2-b978-01115f53c31e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:21.285110 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8433474e-0f2a-47e2-b978-01115f53c31e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:21.285552 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.objects.instance [None req-8433474e-0f2a-47e2-b978-01115f53c31e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lazy-loading 'fault' on Instance uuid d97e6323-aeef-4755-9bc5-93ae5140640b {{(pid=117799) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:21:21.325736 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-8433474e-0f2a-47e2-b978-01115f53c31e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:21:21.334908 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-8433474e-0f2a-47e2-b978-01115f53c31e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:21:21.336450 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-8433474e-0f2a-47e2-b978-01115f53c31e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:21:21.337628 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-8433474e-0f2a-47e2-b978-01115f53c31e tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1371 microversion: 2.20 time: 0.102518 May 26 15:21:21.338176 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 498/967] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:21:21 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:21:22.355939 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d125b612-a026-4ec8-a207-0fa0d166d193 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:21:22.356497 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-d125b612-a026-4ec8-a207-0fa0d166d193 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:21:22.363345 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d125b612-a026-4ec8-a207-0fa0d166d193 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:22.363803 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d125b612-a026-4ec8-a207-0fa0d166d193 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:22.364569 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d125b612-a026-4ec8-a207-0fa0d166d193 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:22.365005 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d125b612-a026-4ec8-a207-0fa0d166d193 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:22.395672 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d125b612-a026-4ec8-a207-0fa0d166d193 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:22.396118 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d125b612-a026-4ec8-a207-0fa0d166d193 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:22.396568 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.objects.instance [None req-d125b612-a026-4ec8-a207-0fa0d166d193 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lazy-loading 'fault' on Instance uuid d97e6323-aeef-4755-9bc5-93ae5140640b {{(pid=117798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:21:22.437734 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d125b612-a026-4ec8-a207-0fa0d166d193 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:21:22.445745 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d125b612-a026-4ec8-a207-0fa0d166d193 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:21:22.447276 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d125b612-a026-4ec8-a207-0fa0d166d193 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:21:22.448435 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-d125b612-a026-4ec8-a207-0fa0d166d193 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1371 microversion: 2.20 time: 0.096534 May 26 15:21:22.448997 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 470/968] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:21:22 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:21:23.468106 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-d37b4fd1-9bc6-43e1-bdea-b5bd00f684be tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:21:23.468674 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-d37b4fd1-9bc6-43e1-bdea-b5bd00f684be tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:21:23.475236 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d37b4fd1-9bc6-43e1-bdea-b5bd00f684be tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:23.475684 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d37b4fd1-9bc6-43e1-bdea-b5bd00f684be tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:23.476454 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d37b4fd1-9bc6-43e1-bdea-b5bd00f684be tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:23.476891 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d37b4fd1-9bc6-43e1-bdea-b5bd00f684be tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:23.508752 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d37b4fd1-9bc6-43e1-bdea-b5bd00f684be tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:23.509200 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d37b4fd1-9bc6-43e1-bdea-b5bd00f684be tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:23.509652 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.objects.instance [None req-d37b4fd1-9bc6-43e1-bdea-b5bd00f684be tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lazy-loading 'fault' on Instance uuid d97e6323-aeef-4755-9bc5-93ae5140640b {{(pid=117799) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:21:23.550339 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-d37b4fd1-9bc6-43e1-bdea-b5bd00f684be tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:21:23.558152 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-d37b4fd1-9bc6-43e1-bdea-b5bd00f684be tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:21:23.559887 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-d37b4fd1-9bc6-43e1-bdea-b5bd00f684be tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1748648695bb46a9b2c7912c48e95bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9de893c8bbd47b59e136fe46e791a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:21:23.561147 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-d37b4fd1-9bc6-43e1-bdea-b5bd00f684be tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 200 len: 1371 microversion: 2.20 time: 0.097948 May 26 15:21:23.561813 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 499/969] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:21:23 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 1371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:21:24.579861 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e7a339e6-986a-49c5-b712-b24dfb011d59 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:21:24.580596 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e7a339e6-986a-49c5-b712-b24dfb011d59 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:21:24.587935 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e7a339e6-986a-49c5-b712-b24dfb011d59 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:24.588445 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e7a339e6-986a-49c5-b712-b24dfb011d59 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:24.589407 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e7a339e6-986a-49c5-b712-b24dfb011d59 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:24.589847 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e7a339e6-986a-49c5-b712-b24dfb011d59 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:24.604720 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-e7a339e6-986a-49c5-b712-b24dfb011d59 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] HTTP exception thrown: Instance d97e6323-aeef-4755-9bc5-93ae5140640b could not be found. May 26 15:21:24.606360 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e7a339e6-986a-49c5-b712-b24dfb011d59 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Request method failure captured: May 26 15:21:24.606360 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: request: GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b HTTP/1.1 May 26 15:21:24.606360 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept: application/json May 26 15:21:24.606360 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity May 26 15:21:24.606360 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Connection: close May 26 15:21:24.606360 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Length: 0 May 26 15:21:24.606360 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Type: application/json May 26 15:21:24.606360 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Host: 10.222.0.45 May 26 15:21:24.606360 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None May 26 15:21:24.606360 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 May 26 15:21:24.606360 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABij5gMVhaWEX4FQhWB7cxAll_mRIZulrKEb1-jv9NcQxjEkpyovpQvUb4aV0JB4IiboU_z62gmhWiu0kDHMzLoVEsSdanxwYqeh5mD-nscxoSx8Ri5L1PuvFc4pJ1fmmy69rhXu7wQagOOyT_Oemd_BLx6I2lQnjvIrhx21H_Td2HryCY May 26 15:21:24.606360 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Id: None May 26 15:21:24.606360 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Name: None May 26 15:21:24.606360 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed May 26 15:21:24.606360 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True May 26 15:21:24.606360 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Openstack-Nova-Api-Version: 2.20 May 26 15:21:24.606360 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default May 26 15:21:24.606360 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default May 26 15:21:24.606360 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Id: b9de893c8bbd47b59e136fe46e791a52 May 26 15:21:24.606360 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-267313914 May 26 15:21:24.606360 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Role: reader,member May 26 15:21:24.606360 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Roles: reader,member May 26 15:21:24.608045 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b9de893c8bbd47b59e136fe46e791a52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b9de893c8bbd47b59e136fe46e791a52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b9de893c8bbd47b59e136fe46e791a52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b9de893c8bbd47b59e136fe46e791a52"}]}] May 26 15:21:24.608045 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-AttachVolumeShelveTestJSON-267313914 May 26 15:21:24.608045 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Id: b9de893c8bbd47b59e136fe46e791a52 May 26 15:21:24.608045 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-267313914 May 26 15:21:24.608045 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User: tempest-AttachVolumeShelveTestJSON-267313914-project May 26 15:21:24.608045 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default May 26 15:21:24.608045 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default May 26 15:21:24.608045 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Id: 1748648695bb46a9b2c7912c48e95bbd May 26 15:21:24.608045 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-AttachVolumeShelveTestJSON-267313914-project May 26 15:21:24.608045 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: method: > May 26 15:21:24.608045 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: exception: Instance d97e6323-aeef-4755-9bc5-93ae5140640b could not be found. May 26 15:21:24.608045 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: action_args: {'id': 'd97e6323-aeef-4755-9bc5-93ae5140640b'} May 26 15:21:24.609734 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:21:24.609734 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:21:24.609734 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:21:24.609734 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:21:24.609734 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:21:24.609734 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:21:24.609734 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:21:24.609734 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:21:24.609734 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:21:24.609734 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:21:24.609734 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d97e6323-aeef-4755-9bc5-93ae5140640b could not be found. May 26 15:21:24.609734 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:21:24.609734 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:21:24.609734 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:21:24.609734 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:21:24.609734 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:21:24.609734 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:21:24.609734 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:21:24.609734 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:21:24.609734 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:21:24.611566 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:21:24.611566 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:21:24.611566 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:21:24.611566 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:21:24.611566 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:21:24.611566 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:21:24.611566 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:21:24.611566 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d97e6323-aeef-4755-9bc5-93ae5140640b could not be found. May 26 15:21:24.611566 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:21:24.611566 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:21:24.611566 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:21:24.611566 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:21:24.611566 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:21:24.611566 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:21:24.611566 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:21:24.611566 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:21:24.611566 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d97e6323-aeef-4755-9bc5-93ae5140640b could not be found. May 26 15:21:24.611566 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:21:24.613144 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e7a339e6-986a-49c5-b712-b24dfb011d59 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Returning 404 to user: Instance d97e6323-aeef-4755-9bc5-93ae5140640b could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:21:24.613144 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e7a339e6-986a-49c5-b712-b24dfb011d59 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 404 len: 111 microversion: 2.20 time: 0.033254 May 26 15:21:24.613144 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 471/970] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:21:24 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 15:21:24.617831 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-bcb6f64e-ac8e-42db-8d09-0c5e44a0f55a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '.version_select at 0x7ffb5d70d670>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:21:24.635427 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-bcb6f64e-ac8e-42db-8d09-0c5e44a0f55a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-488125112" status: 204 len: 0 microversion: 2.20 time: 0.021499 May 26 15:21:24.635985 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 500/971] 10.222.0.45 () {60 vars in 1258 bytes} [Thu May 26 15:21:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-488125112 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 15:21:26.407986 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-3f492d10-86d8-472b-843e-48989d1e2d7a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:21:26.408503 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-3f492d10-86d8-472b-843e-48989d1e2d7a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:21:26.415038 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3f492d10-86d8-472b-843e-48989d1e2d7a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:26.415601 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3f492d10-86d8-472b-843e-48989d1e2d7a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:26.416353 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3f492d10-86d8-472b-843e-48989d1e2d7a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:26.416790 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3f492d10-86d8-472b-843e-48989d1e2d7a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:26.430781 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-3f492d10-86d8-472b-843e-48989d1e2d7a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] HTTP exception thrown: Instance d97e6323-aeef-4755-9bc5-93ae5140640b could not be found. May 26 15:21:26.432365 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-3f492d10-86d8-472b-843e-48989d1e2d7a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Request method failure captured: May 26 15:21:26.432365 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: request: DELETE /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b HTTP/1.1 May 26 15:21:26.432365 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept: application/json May 26 15:21:26.432365 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity May 26 15:21:26.432365 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Connection: close May 26 15:21:26.432365 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Length: 0 May 26 15:21:26.432365 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Type: application/json May 26 15:21:26.432365 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Host: 10.222.0.45 May 26 15:21:26.432365 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None May 26 15:21:26.432365 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 May 26 15:21:26.432365 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABij5gMVhaWEX4FQhWB7cxAll_mRIZulrKEb1-jv9NcQxjEkpyovpQvUb4aV0JB4IiboU_z62gmhWiu0kDHMzLoVEsSdanxwYqeh5mD-nscxoSx8Ri5L1PuvFc4pJ1fmmy69rhXu7wQagOOyT_Oemd_BLx6I2lQnjvIrhx21H_Td2HryCY May 26 15:21:26.432365 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Id: None May 26 15:21:26.432365 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Name: None May 26 15:21:26.432365 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed May 26 15:21:26.432365 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True May 26 15:21:26.432365 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Openstack-Nova-Api-Version: 2.20 May 26 15:21:26.432365 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default May 26 15:21:26.432365 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default May 26 15:21:26.432365 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Id: b9de893c8bbd47b59e136fe46e791a52 May 26 15:21:26.432365 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-267313914 May 26 15:21:26.432365 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Role: reader,member May 26 15:21:26.432365 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Roles: reader,member May 26 15:21:26.434021 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b9de893c8bbd47b59e136fe46e791a52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b9de893c8bbd47b59e136fe46e791a52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b9de893c8bbd47b59e136fe46e791a52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b9de893c8bbd47b59e136fe46e791a52"}]}] May 26 15:21:26.434021 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-AttachVolumeShelveTestJSON-267313914 May 26 15:21:26.434021 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Id: b9de893c8bbd47b59e136fe46e791a52 May 26 15:21:26.434021 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-267313914 May 26 15:21:26.434021 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User: tempest-AttachVolumeShelveTestJSON-267313914-project May 26 15:21:26.434021 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default May 26 15:21:26.434021 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default May 26 15:21:26.434021 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Id: 1748648695bb46a9b2c7912c48e95bbd May 26 15:21:26.434021 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-AttachVolumeShelveTestJSON-267313914-project May 26 15:21:26.434021 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: method: > May 26 15:21:26.434021 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: exception: Instance d97e6323-aeef-4755-9bc5-93ae5140640b could not be found. May 26 15:21:26.434021 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: action_args: {'id': 'd97e6323-aeef-4755-9bc5-93ae5140640b'} May 26 15:21:26.434926 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:21:26.434926 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:21:26.434926 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:21:26.434926 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:21:26.434926 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:21:26.434926 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:21:26.434926 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:21:26.434926 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:21:26.434926 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:21:26.434926 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:21:26.434926 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d97e6323-aeef-4755-9bc5-93ae5140640b could not be found. May 26 15:21:26.434926 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:21:26.434926 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:21:26.434926 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:21:26.434926 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:21:26.434926 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:21:26.434926 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:21:26.434926 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:21:26.434926 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:21:26.434926 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:21:26.437142 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:21:26.437142 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 15:21:26.437142 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 15:21:26.437142 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 15:21:26.437142 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 15:21:26.437142 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:21:26.437142 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:21:26.437142 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:21:26.437142 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:21:26.437142 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d97e6323-aeef-4755-9bc5-93ae5140640b could not be found. May 26 15:21:26.437142 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:21:26.437142 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:21:26.437142 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:21:26.437142 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:21:26.437142 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:21:26.437142 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:21:26.437142 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:21:26.437142 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:21:26.437142 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d97e6323-aeef-4755-9bc5-93ae5140640b could not be found. May 26 15:21:26.437142 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:21:26.438677 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-3f492d10-86d8-472b-843e-48989d1e2d7a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Returning 404 to user: Instance d97e6323-aeef-4755-9bc5-93ae5140640b could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:21:26.438677 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-3f492d10-86d8-472b-843e-48989d1e2d7a tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 404 len: 111 microversion: 2.20 time: 0.029806 May 26 15:21:26.438677 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 472/972] 10.222.0.45 () {60 vars in 1279 bytes} [Thu May 26 15:21:26 2022] DELETE /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 15:21:26.443810 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-56938c96-5973-4569-ac35-f5ce4b5f7a50 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:21:26.444422 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-56938c96-5973-4569-ac35-f5ce4b5f7a50 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: d97e6323-aeef-4755-9bc5-93ae5140640b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:21:26.451230 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-56938c96-5973-4569-ac35-f5ce4b5f7a50 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:26.451920 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-56938c96-5973-4569-ac35-f5ce4b5f7a50 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:26.452481 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-56938c96-5973-4569-ac35-f5ce4b5f7a50 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:26.452917 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-56938c96-5973-4569-ac35-f5ce4b5f7a50 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:26.466230 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.wsgi [None req-56938c96-5973-4569-ac35-f5ce4b5f7a50 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] HTTP exception thrown: Instance d97e6323-aeef-4755-9bc5-93ae5140640b could not be found. May 26 15:21:26.468538 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-56938c96-5973-4569-ac35-f5ce4b5f7a50 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Request method failure captured: May 26 15:21:26.468538 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: request: GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b HTTP/1.1 May 26 15:21:26.468538 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept: application/json May 26 15:21:26.468538 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept-Encoding: identity May 26 15:21:26.468538 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Connection: close May 26 15:21:26.468538 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Length: 0 May 26 15:21:26.468538 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Type: application/json May 26 15:21:26.468538 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Host: 10.222.0.45 May 26 15:21:26.468538 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Openstack-System-Scope: None May 26 15:21:26.468538 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: User-Agent: python-urllib3/1.26.9 May 26 15:21:26.468538 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Auth-Token: gAAAAABij5gMVhaWEX4FQhWB7cxAll_mRIZulrKEb1-jv9NcQxjEkpyovpQvUb4aV0JB4IiboU_z62gmhWiu0kDHMzLoVEsSdanxwYqeh5mD-nscxoSx8Ri5L1PuvFc4pJ1fmmy69rhXu7wQagOOyT_Oemd_BLx6I2lQnjvIrhx21H_Td2HryCY May 26 15:21:26.468538 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Id: None May 26 15:21:26.468538 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Name: None May 26 15:21:26.468538 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Identity-Status: Confirmed May 26 15:21:26.468538 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Is-Admin-Project: True May 26 15:21:26.468538 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Openstack-Nova-Api-Version: 2.20 May 26 15:21:26.468538 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Id: default May 26 15:21:26.468538 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Name: Default May 26 15:21:26.468538 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Id: b9de893c8bbd47b59e136fe46e791a52 May 26 15:21:26.468538 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-267313914 May 26 15:21:26.468538 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Role: reader,member May 26 15:21:26.468538 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Roles: reader,member May 26 15:21:26.470089 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b9de893c8bbd47b59e136fe46e791a52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b9de893c8bbd47b59e136fe46e791a52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b9de893c8bbd47b59e136fe46e791a52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b9de893c8bbd47b59e136fe46e791a52"}]}] May 26 15:21:26.470089 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant: tempest-AttachVolumeShelveTestJSON-267313914 May 26 15:21:26.470089 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Id: b9de893c8bbd47b59e136fe46e791a52 May 26 15:21:26.470089 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-267313914 May 26 15:21:26.470089 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User: tempest-AttachVolumeShelveTestJSON-267313914-project May 26 15:21:26.470089 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Id: default May 26 15:21:26.470089 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Name: Default May 26 15:21:26.470089 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Id: 1748648695bb46a9b2c7912c48e95bbd May 26 15:21:26.470089 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Name: tempest-AttachVolumeShelveTestJSON-267313914-project May 26 15:21:26.470089 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: method: > May 26 15:21:26.470089 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: exception: Instance d97e6323-aeef-4755-9bc5-93ae5140640b could not be found. May 26 15:21:26.470089 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: action_args: {'id': 'd97e6323-aeef-4755-9bc5-93ae5140640b'} May 26 15:21:26.470834 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:21:26.470834 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:21:26.470834 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:21:26.470834 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:21:26.470834 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:21:26.470834 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:21:26.470834 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:21:26.470834 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:21:26.470834 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:21:26.470834 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:21:26.470834 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d97e6323-aeef-4755-9bc5-93ae5140640b could not be found. May 26 15:21:26.470834 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:21:26.470834 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:21:26.470834 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:21:26.470834 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:21:26.470834 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:21:26.470834 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:21:26.470834 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:21:26.470834 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:21:26.470834 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:21:26.472693 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:21:26.472693 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:21:26.472693 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:21:26.472693 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:21:26.472693 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:21:26.472693 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:21:26.472693 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:21:26.472693 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d97e6323-aeef-4755-9bc5-93ae5140640b could not be found. May 26 15:21:26.472693 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:21:26.472693 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:21:26.472693 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:21:26.472693 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:21:26.472693 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:21:26.472693 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:21:26.472693 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:21:26.472693 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:21:26.472693 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d97e6323-aeef-4755-9bc5-93ae5140640b could not be found. May 26 15:21:26.472693 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:21:26.474056 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-56938c96-5973-4569-ac35-f5ce4b5f7a50 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Returning 404 to user: Instance d97e6323-aeef-4755-9bc5-93ae5140640b could not be found. {{(pid=117799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:21:26.474056 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-56938c96-5973-4569-ac35-f5ce4b5f7a50 tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b" status: 404 len: 111 microversion: 2.20 time: 0.030783 May 26 15:21:26.474056 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 501/973] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:21:26 2022] GET /compute/v2.1/servers/d97e6323-aeef-4755-9bc5-93ae5140640b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 15:21:27.612516 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b08036e5-aba8-434f-8e88-28eb98ed365b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:21:27.613629 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b08036e5-aba8-434f-8e88-28eb98ed365b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:21:27.620033 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b08036e5-aba8-434f-8e88-28eb98ed365b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:27.620484 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b08036e5-aba8-434f-8e88-28eb98ed365b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:27.621253 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b08036e5-aba8-434f-8e88-28eb98ed365b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:27.621690 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b08036e5-aba8-434f-8e88-28eb98ed365b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:27.637098 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-b08036e5-aba8-434f-8e88-28eb98ed365b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] HTTP exception thrown: Instance 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 could not be found. May 26 15:21:27.638698 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b08036e5-aba8-434f-8e88-28eb98ed365b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Request method failure captured: May 26 15:21:27.638698 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: request: DELETE /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 HTTP/1.1 May 26 15:21:27.638698 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept: application/json May 26 15:21:27.638698 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity May 26 15:21:27.638698 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Connection: close May 26 15:21:27.638698 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Length: 0 May 26 15:21:27.638698 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Type: application/json May 26 15:21:27.638698 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Host: 10.222.0.45 May 26 15:21:27.638698 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None May 26 15:21:27.638698 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 May 26 15:21:27.638698 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABij5gMVhaWEX4FQhWB7cxAll_mRIZulrKEb1-jv9NcQxjEkpyovpQvUb4aV0JB4IiboU_z62gmhWiu0kDHMzLoVEsSdanxwYqeh5mD-nscxoSx8Ri5L1PuvFc4pJ1fmmy69rhXu7wQagOOyT_Oemd_BLx6I2lQnjvIrhx21H_Td2HryCY May 26 15:21:27.638698 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Id: None May 26 15:21:27.638698 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Name: None May 26 15:21:27.638698 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed May 26 15:21:27.638698 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True May 26 15:21:27.638698 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Openstack-Nova-Api-Version: 2.20 May 26 15:21:27.638698 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default May 26 15:21:27.638698 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default May 26 15:21:27.638698 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Id: b9de893c8bbd47b59e136fe46e791a52 May 26 15:21:27.638698 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-267313914 May 26 15:21:27.638698 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Role: reader,member May 26 15:21:27.638698 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Roles: reader,member May 26 15:21:27.640878 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b9de893c8bbd47b59e136fe46e791a52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b9de893c8bbd47b59e136fe46e791a52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b9de893c8bbd47b59e136fe46e791a52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b9de893c8bbd47b59e136fe46e791a52"}]}] May 26 15:21:27.640878 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-AttachVolumeShelveTestJSON-267313914 May 26 15:21:27.640878 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Id: b9de893c8bbd47b59e136fe46e791a52 May 26 15:21:27.640878 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-267313914 May 26 15:21:27.640878 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User: tempest-AttachVolumeShelveTestJSON-267313914-project May 26 15:21:27.640878 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default May 26 15:21:27.640878 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default May 26 15:21:27.640878 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Id: 1748648695bb46a9b2c7912c48e95bbd May 26 15:21:27.640878 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-AttachVolumeShelveTestJSON-267313914-project May 26 15:21:27.640878 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: method: > May 26 15:21:27.640878 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: exception: Instance 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 could not be found. May 26 15:21:27.640878 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: action_args: {'id': '4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6'} May 26 15:21:27.641957 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:21:27.641957 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:21:27.641957 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:21:27.641957 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:21:27.641957 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:21:27.641957 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:21:27.641957 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:21:27.641957 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:21:27.641957 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:21:27.641957 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:21:27.641957 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 could not be found. May 26 15:21:27.641957 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:21:27.641957 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:21:27.641957 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:21:27.641957 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:21:27.641957 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:21:27.641957 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:21:27.641957 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:21:27.641957 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:21:27.641957 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:21:27.643459 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:21:27.643459 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 15:21:27.643459 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 15:21:27.643459 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 15:21:27.643459 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 15:21:27.643459 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:21:27.643459 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:21:27.643459 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:21:27.643459 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:21:27.643459 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 could not be found. May 26 15:21:27.643459 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:21:27.643459 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:21:27.643459 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:21:27.643459 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:21:27.643459 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:21:27.643459 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:21:27.643459 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:21:27.643459 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:21:27.643459 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 could not be found. May 26 15:21:27.643459 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:21:27.644911 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b08036e5-aba8-434f-8e88-28eb98ed365b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Returning 404 to user: Instance 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:21:27.644911 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b08036e5-aba8-434f-8e88-28eb98ed365b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 404 len: 111 microversion: 2.20 time: 0.031683 May 26 15:21:27.644911 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 473/974] 10.222.0.45 () {60 vars in 1279 bytes} [Thu May 26 15:21:27 2022] DELETE /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 15:21:27.649392 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-d7d5c296-9806-4750-9d5a-510e3bfe4e4b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:21:27.650012 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-d7d5c296-9806-4750-9d5a-510e3bfe4e4b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] [instance: 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:21:27.656484 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d7d5c296-9806-4750-9d5a-510e3bfe4e4b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:27.657053 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d7d5c296-9806-4750-9d5a-510e3bfe4e4b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:27.657698 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d7d5c296-9806-4750-9d5a-510e3bfe4e4b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:27.658141 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-d7d5c296-9806-4750-9d5a-510e3bfe4e4b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:27.672142 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.wsgi [None req-d7d5c296-9806-4750-9d5a-510e3bfe4e4b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] HTTP exception thrown: Instance 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 could not be found. May 26 15:21:27.673682 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-d7d5c296-9806-4750-9d5a-510e3bfe4e4b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Request method failure captured: May 26 15:21:27.673682 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: request: GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 HTTP/1.1 May 26 15:21:27.673682 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept: application/json May 26 15:21:27.673682 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept-Encoding: identity May 26 15:21:27.673682 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Connection: close May 26 15:21:27.673682 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Length: 0 May 26 15:21:27.673682 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Type: application/json May 26 15:21:27.673682 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Host: 10.222.0.45 May 26 15:21:27.673682 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Openstack-System-Scope: None May 26 15:21:27.673682 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: User-Agent: python-urllib3/1.26.9 May 26 15:21:27.673682 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Auth-Token: gAAAAABij5gMVhaWEX4FQhWB7cxAll_mRIZulrKEb1-jv9NcQxjEkpyovpQvUb4aV0JB4IiboU_z62gmhWiu0kDHMzLoVEsSdanxwYqeh5mD-nscxoSx8Ri5L1PuvFc4pJ1fmmy69rhXu7wQagOOyT_Oemd_BLx6I2lQnjvIrhx21H_Td2HryCY May 26 15:21:27.673682 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Id: None May 26 15:21:27.673682 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Name: None May 26 15:21:27.673682 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Identity-Status: Confirmed May 26 15:21:27.673682 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Is-Admin-Project: True May 26 15:21:27.673682 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Openstack-Nova-Api-Version: 2.20 May 26 15:21:27.673682 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Id: default May 26 15:21:27.673682 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Name: Default May 26 15:21:27.673682 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Id: b9de893c8bbd47b59e136fe46e791a52 May 26 15:21:27.673682 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-267313914 May 26 15:21:27.673682 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Role: reader,member May 26 15:21:27.673682 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Roles: reader,member May 26 15:21:27.675322 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b9de893c8bbd47b59e136fe46e791a52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b9de893c8bbd47b59e136fe46e791a52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b9de893c8bbd47b59e136fe46e791a52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b9de893c8bbd47b59e136fe46e791a52"}]}] May 26 15:21:27.675322 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant: tempest-AttachVolumeShelveTestJSON-267313914 May 26 15:21:27.675322 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Id: b9de893c8bbd47b59e136fe46e791a52 May 26 15:21:27.675322 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-267313914 May 26 15:21:27.675322 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User: tempest-AttachVolumeShelveTestJSON-267313914-project May 26 15:21:27.675322 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Id: default May 26 15:21:27.675322 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Name: Default May 26 15:21:27.675322 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Id: 1748648695bb46a9b2c7912c48e95bbd May 26 15:21:27.675322 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Name: tempest-AttachVolumeShelveTestJSON-267313914-project May 26 15:21:27.675322 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: method: > May 26 15:21:27.675322 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: exception: Instance 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 could not be found. May 26 15:21:27.675322 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: action_args: {'id': '4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6'} May 26 15:21:27.676169 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:21:27.676169 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:21:27.676169 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:21:27.676169 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:21:27.676169 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:21:27.676169 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:21:27.676169 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:21:27.676169 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:21:27.676169 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:21:27.676169 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:21:27.676169 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 could not be found. May 26 15:21:27.676169 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:21:27.676169 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:21:27.676169 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:21:27.676169 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:21:27.676169 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:21:27.676169 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:21:27.676169 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:21:27.676169 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:21:27.676169 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:21:27.677921 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:21:27.677921 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:21:27.677921 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:21:27.677921 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:21:27.677921 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:21:27.677921 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:21:27.677921 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:21:27.677921 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 could not be found. May 26 15:21:27.677921 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:21:27.677921 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:21:27.677921 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:21:27.677921 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:21:27.677921 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:21:27.677921 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:21:27.677921 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:21:27.677921 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:21:27.677921 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 could not be found. May 26 15:21:27.677921 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:21:27.679216 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-d7d5c296-9806-4750-9d5a-510e3bfe4e4b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] Returning 404 to user: Instance 4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 could not be found. {{(pid=117799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:21:27.679216 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-d7d5c296-9806-4750-9d5a-510e3bfe4e4b tempest-AttachVolumeShelveTestJSON-267313914 tempest-AttachVolumeShelveTestJSON-267313914-project] 10.222.0.45 "GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6" status: 404 len: 111 microversion: 2.20 time: 0.029983 May 26 15:21:27.679216 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 502/975] 10.222.0.45 () {60 vars in 1276 bytes} [Thu May 26 15:21:27 2022] GET /compute/v2.1/servers/4d99733c-1bb2-402b-b9c6-02a2b6d0f5d6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 15:21:56.167921 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-4a7fc60e-9aef-488c-a2e6-c75a375531a1 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-169830593", "imageRef": "5b5a68b4-38e3-4f05-b97f-4339d6752e34", "flavorRef": "452", "networks": [{"uuid": "f430d388-aa0f-41ed-8763-0abc1d92b03d"}]}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:21:56.176548 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=20 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:56.177308 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=27 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:56.222243 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.network.neutron [None req-4a7fc60e-9aef-488c-a2e6-c75a375531a1 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] validate_networks() for [('f430d388-aa0f-41ed-8763-0abc1d92b03d', None, None, None, None, None)] {{(pid=117798) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:21:56.609861 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-4a7fc60e-9aef-488c-a2e6-c75a375531a1 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Flavor limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:21:56.610354 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-4a7fc60e-9aef-488c-a2e6-c75a375531a1 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Image limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:21:56.610955 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-4a7fc60e-9aef-488c-a2e6-c75a375531a1 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Flavor pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:21:56.611459 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-4a7fc60e-9aef-488c-a2e6-c75a375531a1 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Image pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:21:56.612158 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-4a7fc60e-9aef-488c-a2e6-c75a375531a1 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:21:56.625491 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4a7fc60e-9aef-488c-a2e6-c75a375531a1 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:56.625491 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4a7fc60e-9aef-488c-a2e6-c75a375531a1 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:56.625491 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4a7fc60e-9aef-488c-a2e6-c75a375531a1 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:21:56.625491 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4a7fc60e-9aef-488c-a2e6-c75a375531a1 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:21:56.642870 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-4a7fc60e-9aef-488c-a2e6-c75a375531a1 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Getting quotas for project 4275e360373049f996bc3679e7f921a3. Resources: {'cores', 'ram', 'instances'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:21:56.646603 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-4a7fc60e-9aef-488c-a2e6-c75a375531a1 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Getting quotas for user ac5ab9cfa5d346b08a2c9070656fa62a and project 4275e360373049f996bc3679e7f921a3. Resources: {'cores', 'ram', 'instances'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:21:56.657930 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-4a7fc60e-9aef-488c-a2e6-c75a375531a1 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Going to run 1 instances... {{(pid=117798) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:21:56.660185 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-4a7fc60e-9aef-488c-a2e6-c75a375531a1 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: c771f26f-c478-40e9-95de-9c42db3f2aa8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5b5a68b4-38e3-4f05-b97f-4339d6752e34',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:21:56.709713 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-4a7fc60e-9aef-488c-a2e6-c75a375531a1 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.545851 May 26 15:21:56.710754 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 474/976] 10.222.0.45 () {60 vars in 1146 bytes} [Thu May 26 15:21:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 15:21:56.723020 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-8311997b-5e67-4db3-8864-778e5045f640 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:21:56.724217 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-8311997b-5e67-4db3-8864-778e5045f640 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: c771f26f-c478-40e9-95de-9c42db3f2aa8] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:21:56.728120 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:56.729832 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=21 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:21:56.791773 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-8311997b-5e67-4db3-8864-778e5045f640 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:21:56.799575 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-8311997b-5e67-4db3-8864-778e5045f640 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8" status: 200 len: 1213 microversion: 2.1 time: 0.081001 May 26 15:21:56.800264 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 503/977] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:21:56 2022] GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:21:57.818686 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f478f208-b08e-4460-977c-243cec7661b0 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:21:57.823453 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f478f208-b08e-4460-977c-243cec7661b0 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: c771f26f-c478-40e9-95de-9c42db3f2aa8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:21:57.883058 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f478f208-b08e-4460-977c-243cec7661b0 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:21:57.890894 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f478f208-b08e-4460-977c-243cec7661b0 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8" status: 200 len: 1213 microversion: 2.1 time: 0.078542 May 26 15:21:57.891574 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 475/978] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:21:57 2022] GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:21:58.908845 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-ab4c2493-7282-4d7e-8600-5cd690510d44 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:21:58.909431 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-ab4c2493-7282-4d7e-8600-5cd690510d44 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: c771f26f-c478-40e9-95de-9c42db3f2aa8] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:21:58.969481 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-ab4c2493-7282-4d7e-8600-5cd690510d44 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:21:58.977476 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-ab4c2493-7282-4d7e-8600-5cd690510d44 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8" status: 200 len: 1213 microversion: 2.1 time: 0.072492 May 26 15:21:58.978323 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 504/979] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:21:58 2022] GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8 => generated 1213 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:21:59.998668 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ce96f31d-d6ee-4793-a8ec-865de62d07e2 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:21:59.999310 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ce96f31d-d6ee-4793-a8ec-865de62d07e2 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: c771f26f-c478-40e9-95de-9c42db3f2aa8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:00.070730 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ce96f31d-d6ee-4793-a8ec-865de62d07e2 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:00.081302 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ce96f31d-d6ee-4793-a8ec-865de62d07e2 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8" status: 200 len: 1213 microversion: 2.1 time: 0.090097 May 26 15:22:00.082424 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 476/980] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:21:59 2022] GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8 => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:01.100093 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-794d1664-ee15-4faf-b1d2-94104f7945bd tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:01.100711 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-794d1664-ee15-4faf-b1d2-94104f7945bd tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: c771f26f-c478-40e9-95de-9c42db3f2aa8] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:01.108109 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-794d1664-ee15-4faf-b1d2-94104f7945bd tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:01.108563 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-794d1664-ee15-4faf-b1d2-94104f7945bd tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:01.109329 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-794d1664-ee15-4faf-b1d2-94104f7945bd tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:01.109772 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-794d1664-ee15-4faf-b1d2-94104f7945bd tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:01.169955 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-794d1664-ee15-4faf-b1d2-94104f7945bd tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:01.177878 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-794d1664-ee15-4faf-b1d2-94104f7945bd tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8" status: 200 len: 1217 microversion: 2.1 time: 0.081652 May 26 15:22:01.178447 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 505/981] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:01 2022] GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:02.195517 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-22689e0f-70de-4251-a09a-f8771f160843 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:02.196140 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-22689e0f-70de-4251-a09a-f8771f160843 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: c771f26f-c478-40e9-95de-9c42db3f2aa8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:02.205719 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-22689e0f-70de-4251-a09a-f8771f160843 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:02.206158 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-22689e0f-70de-4251-a09a-f8771f160843 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:02.206922 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-22689e0f-70de-4251-a09a-f8771f160843 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:02.207382 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-22689e0f-70de-4251-a09a-f8771f160843 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:02.268598 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-22689e0f-70de-4251-a09a-f8771f160843 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:02.276204 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-22689e0f-70de-4251-a09a-f8771f160843 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8" status: 200 len: 1271 microversion: 2.1 time: 0.084781 May 26 15:22:02.276773 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 477/982] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:02 2022] GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8 => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:03.293893 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-283fee04-24da-47ca-8e94-48541436be24 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:03.295174 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-283fee04-24da-47ca-8e94-48541436be24 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: c771f26f-c478-40e9-95de-9c42db3f2aa8] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:03.301753 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-283fee04-24da-47ca-8e94-48541436be24 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:03.302193 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-283fee04-24da-47ca-8e94-48541436be24 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:03.302994 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-283fee04-24da-47ca-8e94-48541436be24 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:03.303478 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-283fee04-24da-47ca-8e94-48541436be24 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:03.367235 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-283fee04-24da-47ca-8e94-48541436be24 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:03.375234 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-283fee04-24da-47ca-8e94-48541436be24 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8" status: 200 len: 1271 microversion: 2.1 time: 0.085193 May 26 15:22:03.375762 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 506/983] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:03 2022] GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8 => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:04.393113 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ff15067b-5e3c-4d4d-b233-2bcbe5749a69 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:04.394321 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ff15067b-5e3c-4d4d-b233-2bcbe5749a69 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: c771f26f-c478-40e9-95de-9c42db3f2aa8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:04.401303 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ff15067b-5e3c-4d4d-b233-2bcbe5749a69 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:04.401693 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ff15067b-5e3c-4d4d-b233-2bcbe5749a69 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:04.402458 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ff15067b-5e3c-4d4d-b233-2bcbe5749a69 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:04.402890 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ff15067b-5e3c-4d4d-b233-2bcbe5749a69 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:04.452006 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-835227ef-db96-4b41-834a-97f6ac457119 req-78cf0bb4-fc7a-46e5-8016-fcbb853785a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c771f26f-c478-40e9-95de-9c42db3f2aa8", "tag": "33401d7c-52ea-42cb-b06d-4d273b7b966c"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:22:04.477515 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-835227ef-db96-4b41-834a-97f6ac457119 req-78cf0bb4-fc7a-46e5-8016-fcbb853785a2 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:04.477963 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-835227ef-db96-4b41-834a-97f6ac457119 req-78cf0bb4-fc7a-46e5-8016-fcbb853785a2 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:04.489535 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-835227ef-db96-4b41-834a-97f6ac457119 req-78cf0bb4-fc7a-46e5-8016-fcbb853785a2 service nova] Creating event network-changed:33401d7c-52ea-42cb-b06d-4d273b7b966c for instance c771f26f-c478-40e9-95de-9c42db3f2aa8 on hv-cinder-84301 May 26 15:22:04.494888 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-835227ef-db96-4b41-834a-97f6ac457119 req-78cf0bb4-fc7a-46e5-8016-fcbb853785a2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047583 May 26 15:22:04.495524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 507/984] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:22:04.567762 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ff15067b-5e3c-4d4d-b233-2bcbe5749a69 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:04.575206 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ff15067b-5e3c-4d4d-b233-2bcbe5749a69 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8" status: 200 len: 1313 microversion: 2.1 time: 0.186215 May 26 15:22:04.576036 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 478/985] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:04 2022] GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:05.593203 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-35f2060f-7c0d-442f-b79d-beff3bdefb81 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:05.593893 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-35f2060f-7c0d-442f-b79d-beff3bdefb81 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: c771f26f-c478-40e9-95de-9c42db3f2aa8] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:05.600524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-35f2060f-7c0d-442f-b79d-beff3bdefb81 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:05.600968 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-35f2060f-7c0d-442f-b79d-beff3bdefb81 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:05.601723 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-35f2060f-7c0d-442f-b79d-beff3bdefb81 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:05.602151 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-35f2060f-7c0d-442f-b79d-beff3bdefb81 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:05.743306 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-35f2060f-7c0d-442f-b79d-beff3bdefb81 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:05.751780 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-35f2060f-7c0d-442f-b79d-beff3bdefb81 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8" status: 200 len: 1313 microversion: 2.1 time: 0.163019 May 26 15:22:05.752357 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 508/986] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:05 2022] GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:06.769521 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ade126eb-6fdb-459e-a588-1ebc20eb9f5f tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:06.770123 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ade126eb-6fdb-459e-a588-1ebc20eb9f5f tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: c771f26f-c478-40e9-95de-9c42db3f2aa8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:06.772503 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=2 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:06.778014 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ade126eb-6fdb-459e-a588-1ebc20eb9f5f tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:06.779031 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ade126eb-6fdb-459e-a588-1ebc20eb9f5f tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:06.779823 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ade126eb-6fdb-459e-a588-1ebc20eb9f5f tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:06.780257 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ade126eb-6fdb-459e-a588-1ebc20eb9f5f tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:06.912989 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ade126eb-6fdb-459e-a588-1ebc20eb9f5f tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:06.920930 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ade126eb-6fdb-459e-a588-1ebc20eb9f5f tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8" status: 200 len: 1313 microversion: 2.1 time: 0.155393 May 26 15:22:06.921683 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 479/987] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:06 2022] GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:07.938355 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-33a4c815-2462-42dd-8fbc-6b75d5e04012 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:07.938999 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-33a4c815-2462-42dd-8fbc-6b75d5e04012 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: c771f26f-c478-40e9-95de-9c42db3f2aa8] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:07.946141 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-33a4c815-2462-42dd-8fbc-6b75d5e04012 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:07.946597 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-33a4c815-2462-42dd-8fbc-6b75d5e04012 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:07.947407 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-33a4c815-2462-42dd-8fbc-6b75d5e04012 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:07.947849 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-33a4c815-2462-42dd-8fbc-6b75d5e04012 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:08.081093 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-33a4c815-2462-42dd-8fbc-6b75d5e04012 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:08.089524 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-33a4c815-2462-42dd-8fbc-6b75d5e04012 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8" status: 200 len: 1313 microversion: 2.1 time: 0.155602 May 26 15:22:08.090308 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 509/988] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:07 2022] GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:09.108965 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d27bdb8c-e566-49cf-8fd7-37647254406b tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:09.109570 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-d27bdb8c-e566-49cf-8fd7-37647254406b tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: c771f26f-c478-40e9-95de-9c42db3f2aa8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:09.116091 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d27bdb8c-e566-49cf-8fd7-37647254406b tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:09.116533 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d27bdb8c-e566-49cf-8fd7-37647254406b tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:09.117311 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d27bdb8c-e566-49cf-8fd7-37647254406b tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:09.117746 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d27bdb8c-e566-49cf-8fd7-37647254406b tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:09.246358 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d27bdb8c-e566-49cf-8fd7-37647254406b tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:09.253895 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-d27bdb8c-e566-49cf-8fd7-37647254406b tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8" status: 200 len: 1313 microversion: 2.1 time: 0.149386 May 26 15:22:09.254470 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 480/989] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:09 2022] GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:10.270234 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-9d5c75f1-f5b2-430a-8e96-b25a2ee7471a tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:10.270843 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-9d5c75f1-f5b2-430a-8e96-b25a2ee7471a tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: c771f26f-c478-40e9-95de-9c42db3f2aa8] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:10.273360 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell0:SELECT=4 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:10.279527 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9d5c75f1-f5b2-430a-8e96-b25a2ee7471a tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:10.280019 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9d5c75f1-f5b2-430a-8e96-b25a2ee7471a tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:10.280788 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9d5c75f1-f5b2-430a-8e96-b25a2ee7471a tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:10.281217 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9d5c75f1-f5b2-430a-8e96-b25a2ee7471a tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:10.423593 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-9d5c75f1-f5b2-430a-8e96-b25a2ee7471a tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:10.431209 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-9d5c75f1-f5b2-430a-8e96-b25a2ee7471a tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8" status: 200 len: 1313 microversion: 2.1 time: 0.164757 May 26 15:22:10.431783 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 510/990] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:10 2022] GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:11.450268 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c4ec2f02-ca1c-4199-972c-3e4490731b8e tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:11.451101 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c4ec2f02-ca1c-4199-972c-3e4490731b8e tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: c771f26f-c478-40e9-95de-9c42db3f2aa8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:11.453132 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=10 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:11.459176 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c4ec2f02-ca1c-4199-972c-3e4490731b8e tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:11.459664 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c4ec2f02-ca1c-4199-972c-3e4490731b8e tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:11.460494 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c4ec2f02-ca1c-4199-972c-3e4490731b8e tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:11.460966 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c4ec2f02-ca1c-4199-972c-3e4490731b8e tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:11.595832 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c4ec2f02-ca1c-4199-972c-3e4490731b8e tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:11.603354 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c4ec2f02-ca1c-4199-972c-3e4490731b8e tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8" status: 200 len: 1313 microversion: 2.1 time: 0.157504 May 26 15:22:11.604148 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 481/991] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:11 2022] GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:12.188406 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-ced436ee-8641-40a3-a25e-ef6a10a138d4 req-2dda9baa-94a2-4255-a3a8-07c03a05a3cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c771f26f-c478-40e9-95de-9c42db3f2aa8", "name": "network-vif-plugged", "status": "completed", "tag": "33401d7c-52ea-42cb-b06d-4d273b7b966c"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:22:12.203454 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-ced436ee-8641-40a3-a25e-ef6a10a138d4 req-2dda9baa-94a2-4255-a3a8-07c03a05a3cf service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:12.204160 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-ced436ee-8641-40a3-a25e-ef6a10a138d4 req-2dda9baa-94a2-4255-a3a8-07c03a05a3cf service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:12.216119 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-ced436ee-8641-40a3-a25e-ef6a10a138d4 req-2dda9baa-94a2-4255-a3a8-07c03a05a3cf service nova] Creating event network-vif-plugged:33401d7c-52ea-42cb-b06d-4d273b7b966c for instance c771f26f-c478-40e9-95de-9c42db3f2aa8 on hv-cinder-84301 May 26 15:22:12.221348 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-ced436ee-8641-40a3-a25e-ef6a10a138d4 req-2dda9baa-94a2-4255-a3a8-07c03a05a3cf service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037808 May 26 15:22:12.222166 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 511/992] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:22:12.620095 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-361b734e-fab0-4bfb-a476-2cc3410fcca3 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:12.620817 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-361b734e-fab0-4bfb-a476-2cc3410fcca3 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: c771f26f-c478-40e9-95de-9c42db3f2aa8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:12.627993 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-361b734e-fab0-4bfb-a476-2cc3410fcca3 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:12.628469 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-361b734e-fab0-4bfb-a476-2cc3410fcca3 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:12.629497 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-361b734e-fab0-4bfb-a476-2cc3410fcca3 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:12.629938 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-361b734e-fab0-4bfb-a476-2cc3410fcca3 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:12.811161 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-361b734e-fab0-4bfb-a476-2cc3410fcca3 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:12.819068 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-361b734e-fab0-4bfb-a476-2cc3410fcca3 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8" status: 200 len: 1313 microversion: 2.1 time: 0.202839 May 26 15:22:12.819734 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 482/993] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:12 2022] GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8 => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:13.837988 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-922b95bc-01ff-457e-8d8d-c35891aee43c tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:13.838695 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-922b95bc-01ff-457e-8d8d-c35891aee43c tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: c771f26f-c478-40e9-95de-9c42db3f2aa8] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:13.845735 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-922b95bc-01ff-457e-8d8d-c35891aee43c tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:13.846108 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-922b95bc-01ff-457e-8d8d-c35891aee43c tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:13.847122 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-922b95bc-01ff-457e-8d8d-c35891aee43c tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:13.847745 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-922b95bc-01ff-457e-8d8d-c35891aee43c tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:14.142423 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-922b95bc-01ff-457e-8d8d-c35891aee43c tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:14.151772 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-922b95bc-01ff-457e-8d8d-c35891aee43c tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8" status: 200 len: 1313 microversion: 2.1 time: 0.318398 May 26 15:22:14.156952 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 512/994] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:13 2022] GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8 => generated 1313 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:15.173840 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a8798d88-f592-4833-8570-91b6cd892ab0 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:15.174458 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a8798d88-f592-4833-8570-91b6cd892ab0 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: c771f26f-c478-40e9-95de-9c42db3f2aa8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:15.198368 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a8798d88-f592-4833-8570-91b6cd892ab0 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:15.201738 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a8798d88-f592-4833-8570-91b6cd892ab0 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:15.202934 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a8798d88-f592-4833-8570-91b6cd892ab0 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:15.203586 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a8798d88-f592-4833-8570-91b6cd892ab0 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:15.488882 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a8798d88-f592-4833-8570-91b6cd892ab0 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:15.498590 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a8798d88-f592-4833-8570-91b6cd892ab0 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8" status: 200 len: 1497 microversion: 2.1 time: 0.328663 May 26 15:22:15.501768 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 483/995] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:15 2022] GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8 => generated 1497 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:16.074521 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-fbd9b400-ce29-4bbd-9f90-3c85b2c9b278 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:16.075338 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-fbd9b400-ce29-4bbd-9f90-3c85b2c9b278 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: c771f26f-c478-40e9-95de-9c42db3f2aa8] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:16.082495 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fbd9b400-ce29-4bbd-9f90-3c85b2c9b278 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:16.083861 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fbd9b400-ce29-4bbd-9f90-3c85b2c9b278 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:16.084654 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fbd9b400-ce29-4bbd-9f90-3c85b2c9b278 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:16.085281 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fbd9b400-ce29-4bbd-9f90-3c85b2c9b278 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:16.114578 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-fbd9b400-ce29-4bbd-9f90-3c85b2c9b278 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: c771f26f-c478-40e9-95de-9c42db3f2aa8] Going to try to terminate instance {{(pid=117799) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:22:16.214083 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-fbd9b400-ce29-4bbd-9f90-3c85b2c9b278 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8" status: 204 len: 0 microversion: 2.1 time: 0.143081 May 26 15:22:16.214897 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 513/996] 10.222.0.45 () {58 vars in 1238 bytes} [Thu May 26 15:22:16 2022] DELETE /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:22:16.224507 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-cf9cea76-0566-4cfd-88aa-4bc64a1ef0c9 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:16.225795 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-cf9cea76-0566-4cfd-88aa-4bc64a1ef0c9 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: c771f26f-c478-40e9-95de-9c42db3f2aa8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:16.233404 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cf9cea76-0566-4cfd-88aa-4bc64a1ef0c9 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:16.234233 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cf9cea76-0566-4cfd-88aa-4bc64a1ef0c9 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:16.235127 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cf9cea76-0566-4cfd-88aa-4bc64a1ef0c9 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:16.235664 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cf9cea76-0566-4cfd-88aa-4bc64a1ef0c9 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:16.374336 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-cf9cea76-0566-4cfd-88aa-4bc64a1ef0c9 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:16.383229 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-cf9cea76-0566-4cfd-88aa-4bc64a1ef0c9 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8" status: 200 len: 1503 microversion: 2.1 time: 0.163077 May 26 15:22:16.383813 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 484/997] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:16 2022] GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8 => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:17.406699 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-73421d30-1513-4ac4-a233-ba21873bfd7d tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:17.407954 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-73421d30-1513-4ac4-a233-ba21873bfd7d tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: c771f26f-c478-40e9-95de-9c42db3f2aa8] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:17.430032 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-73421d30-1513-4ac4-a233-ba21873bfd7d tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:17.431127 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-73421d30-1513-4ac4-a233-ba21873bfd7d tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:17.433062 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-73421d30-1513-4ac4-a233-ba21873bfd7d tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:17.433701 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-73421d30-1513-4ac4-a233-ba21873bfd7d tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:17.645075 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-73421d30-1513-4ac4-a233-ba21873bfd7d tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:17.656072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-73421d30-1513-4ac4-a233-ba21873bfd7d tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8" status: 200 len: 1503 microversion: 2.1 time: 0.257221 May 26 15:22:17.657515 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 514/998] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:17 2022] GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8 => generated 1503 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:18.549667 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-ad726cd5-c6bd-4181-8f14-d603e70eeeca req-3b2473ca-7803-4843-95b2-cd59a95c4b01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c771f26f-c478-40e9-95de-9c42db3f2aa8", "name": "network-vif-deleted", "tag": "33401d7c-52ea-42cb-b06d-4d273b7b966c"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:22:18.565928 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-ad726cd5-c6bd-4181-8f14-d603e70eeeca req-3b2473ca-7803-4843-95b2-cd59a95c4b01 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:18.566380 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-ad726cd5-c6bd-4181-8f14-d603e70eeeca req-3b2473ca-7803-4843-95b2-cd59a95c4b01 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:18.599531 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-ad726cd5-c6bd-4181-8f14-d603e70eeeca req-3b2473ca-7803-4843-95b2-cd59a95c4b01 service nova] Creating event network-vif-deleted:33401d7c-52ea-42cb-b06d-4d273b7b966c for instance c771f26f-c478-40e9-95de-9c42db3f2aa8 on hv-cinder-84301 May 26 15:22:18.629762 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-ad726cd5-c6bd-4181-8f14-d603e70eeeca req-3b2473ca-7803-4843-95b2-cd59a95c4b01 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084502 May 26 15:22:18.630300 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 485/999] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:22:18.674887 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-243f2748-b521-4a4e-9b6f-1766bd902395 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:18.675896 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-243f2748-b521-4a4e-9b6f-1766bd902395 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: c771f26f-c478-40e9-95de-9c42db3f2aa8] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:18.693057 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-243f2748-b521-4a4e-9b6f-1766bd902395 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:18.694442 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-243f2748-b521-4a4e-9b6f-1766bd902395 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:18.695546 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-243f2748-b521-4a4e-9b6f-1766bd902395 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:18.696575 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-243f2748-b521-4a4e-9b6f-1766bd902395 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:18.762246 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-243f2748-b521-4a4e-9b6f-1766bd902395 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:18.763386 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-243f2748-b521-4a4e-9b6f-1766bd902395 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:18.764136 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.objects.instance [None req-243f2748-b521-4a4e-9b6f-1766bd902395 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lazy-loading 'fault' on Instance uuid c771f26f-c478-40e9-95de-9c42db3f2aa8 {{(pid=117799) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:22:18.846121 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-243f2748-b521-4a4e-9b6f-1766bd902395 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:18.857097 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-243f2748-b521-4a4e-9b6f-1766bd902395 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8" status: 200 len: 1303 microversion: 2.1 time: 0.185839 May 26 15:22:18.858392 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 515/1000] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:18 2022] GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8 => generated 1303 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:19.875916 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-290831d5-d4a2-45ea-a215-83256bec4d27 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:19.877098 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-290831d5-d4a2-45ea-a215-83256bec4d27 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: c771f26f-c478-40e9-95de-9c42db3f2aa8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:19.891878 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-290831d5-d4a2-45ea-a215-83256bec4d27 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:19.892349 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-290831d5-d4a2-45ea-a215-83256bec4d27 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:19.893345 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-290831d5-d4a2-45ea-a215-83256bec4d27 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:19.893941 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-290831d5-d4a2-45ea-a215-83256bec4d27 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:19.909593 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-290831d5-d4a2-45ea-a215-83256bec4d27 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] HTTP exception thrown: Instance c771f26f-c478-40e9-95de-9c42db3f2aa8 could not be found. May 26 15:22:19.911385 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-290831d5-d4a2-45ea-a215-83256bec4d27 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Request method failure captured: May 26 15:22:19.911385 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: request: GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8 HTTP/1.1 May 26 15:22:19.911385 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept: application/json May 26 15:22:19.911385 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity May 26 15:22:19.911385 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Connection: close May 26 15:22:19.911385 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Length: 0 May 26 15:22:19.911385 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Type: application/json May 26 15:22:19.911385 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Host: 10.222.0.45 May 26 15:22:19.911385 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None May 26 15:22:19.911385 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 May 26 15:22:19.911385 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABij5sSVDdXFpTKikxONXETMU3bqp5yLQWVd__734XF4fmB4HI6gFAY7A54PzwYtQXpATVJFT3LXcvnx94Jyo41gmjuXCpsWlzLEjL6okoyv1FBU5k8Ecs-xXts_IZMkSKiI8FwYki0N5H-A3YgYLHQko1gc42Tiw3JC1RQxHGh0jEobFs May 26 15:22:19.911385 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Id: None May 26 15:22:19.911385 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Name: None May 26 15:22:19.911385 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed May 26 15:22:19.911385 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True May 26 15:22:19.911385 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default May 26 15:22:19.911385 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default May 26 15:22:19.911385 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Id: 4275e360373049f996bc3679e7f921a3 May 26 15:22:19.911385 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-VolumesActionsTest-1293108570 May 26 15:22:19.911385 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Role: reader,member May 26 15:22:19.911385 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Roles: reader,member May 26 15:22:19.913059 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4275e360373049f996bc3679e7f921a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4275e360373049f996bc3679e7f921a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4275e360373049f996bc3679e7f921a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4275e360373049f996bc3679e7f921a3"}]}] May 26 15:22:19.913059 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-VolumesActionsTest-1293108570 May 26 15:22:19.913059 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Id: 4275e360373049f996bc3679e7f921a3 May 26 15:22:19.913059 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-VolumesActionsTest-1293108570 May 26 15:22:19.913059 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User: tempest-VolumesActionsTest-1293108570-project May 26 15:22:19.913059 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default May 26 15:22:19.913059 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default May 26 15:22:19.913059 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Id: ac5ab9cfa5d346b08a2c9070656fa62a May 26 15:22:19.913059 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-VolumesActionsTest-1293108570-project May 26 15:22:19.913059 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: method: > May 26 15:22:19.913059 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: exception: Instance c771f26f-c478-40e9-95de-9c42db3f2aa8 could not be found. May 26 15:22:19.913059 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: action_args: {'id': 'c771f26f-c478-40e9-95de-9c42db3f2aa8'} May 26 15:22:19.914018 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:22:19.914018 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:22:19.914018 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:22:19.914018 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:22:19.914018 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:22:19.914018 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:22:19.914018 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:22:19.914018 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:22:19.914018 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:22:19.914018 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:22:19.914018 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c771f26f-c478-40e9-95de-9c42db3f2aa8 could not be found. May 26 15:22:19.914018 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:22:19.914018 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:22:19.914018 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:22:19.914018 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:22:19.914018 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:22:19.914018 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:22:19.914018 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:22:19.914018 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:22:19.914018 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:22:19.915849 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:22:19.915849 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:22:19.915849 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:22:19.915849 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:22:19.915849 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:22:19.915849 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:22:19.915849 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:22:19.915849 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c771f26f-c478-40e9-95de-9c42db3f2aa8 could not be found. May 26 15:22:19.915849 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:22:19.915849 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:22:19.915849 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:22:19.915849 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:22:19.915849 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:22:19.915849 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:22:19.915849 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:22:19.915849 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:22:19.915849 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c771f26f-c478-40e9-95de-9c42db3f2aa8 could not be found. May 26 15:22:19.915849 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:22:19.917753 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-290831d5-d4a2-45ea-a215-83256bec4d27 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Returning 404 to user: Instance c771f26f-c478-40e9-95de-9c42db3f2aa8 could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:22:19.917753 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-290831d5-d4a2-45ea-a215-83256bec4d27 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8" status: 404 len: 111 microversion: 2.1 time: 0.042801 May 26 15:22:19.917753 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 486/1001] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:19 2022] GET /compute/v2.1/servers/c771f26f-c478-40e9-95de-9c42db3f2aa8 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:22:20.143536 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-80577ae1-3ce9-4a92-a300-a5265df8f08f tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-682621809", "imageRef": "5b5a68b4-38e3-4f05-b97f-4339d6752e34", "flavorRef": "452", "networks": [{"uuid": "f430d388-aa0f-41ed-8763-0abc1d92b03d"}]}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:22:20.232053 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.network.neutron [None req-80577ae1-3ce9-4a92-a300-a5265df8f08f tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] validate_networks() for [('f430d388-aa0f-41ed-8763-0abc1d92b03d', None, None, None, None, None)] {{(pid=117799) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:22:21.607505 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-80577ae1-3ce9-4a92-a300-a5265df8f08f tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Flavor limits 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:22:21.608747 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-80577ae1-3ce9-4a92-a300-a5265df8f08f tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Image limits 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:22:21.609587 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-80577ae1-3ce9-4a92-a300-a5265df8f08f tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Flavor pref 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:22:21.611035 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-80577ae1-3ce9-4a92-a300-a5265df8f08f tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Image pref 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:22:21.611741 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-80577ae1-3ce9-4a92-a300-a5265df8f08f tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:22:21.638294 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-80577ae1-3ce9-4a92-a300-a5265df8f08f tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:21.639100 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-80577ae1-3ce9-4a92-a300-a5265df8f08f tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:21.641315 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-80577ae1-3ce9-4a92-a300-a5265df8f08f tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:21.644356 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-80577ae1-3ce9-4a92-a300-a5265df8f08f tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:21.710388 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.quota [None req-80577ae1-3ce9-4a92-a300-a5265df8f08f tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Getting quotas for project 4275e360373049f996bc3679e7f921a3. Resources: {'cores', 'ram', 'instances'} {{(pid=117799) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:22:21.730775 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.quota [None req-80577ae1-3ce9-4a92-a300-a5265df8f08f tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Getting quotas for user ac5ab9cfa5d346b08a2c9070656fa62a and project 4275e360373049f996bc3679e7f921a3. Resources: {'cores', 'ram', 'instances'} {{(pid=117799) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:22:21.766039 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-80577ae1-3ce9-4a92-a300-a5265df8f08f tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Going to run 1 instances... {{(pid=117799) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:22:21.768538 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-80577ae1-3ce9-4a92-a300-a5265df8f08f tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: b83cab61-051b-47c0-9f96-1cb01695e548] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5b5a68b4-38e3-4f05-b97f-4339d6752e34',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117799) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:22:21.834588 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR oslo.messaging._drivers.impl_rabbit [None req-80577ae1-3ce9-4a92-a300-a5265df8f08f tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [62914327-b3b0-44ab-80f7-575e140dbf67] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 26 15:22:22.847108 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO oslo.messaging._drivers.impl_rabbit [None req-80577ae1-3ce9-4a92-a300-a5265df8f08f tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [62914327-b3b0-44ab-80f7-575e140dbf67] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 53838. May 26 15:22:22.856999 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-80577ae1-3ce9-4a92-a300-a5265df8f08f tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.717777 May 26 15:22:22.857814 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 516/1002] 10.222.0.45 () {60 vars in 1146 bytes} [Thu May 26 15:22:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 15:22:22.867858 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-6eb93311-6713-411f-ac06-1d040ea35377 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:22.868481 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-6eb93311-6713-411f-ac06-1d040ea35377 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: b83cab61-051b-47c0-9f96-1cb01695e548] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:22.954107 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6eb93311-6713-411f-ac06-1d040ea35377 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:22.966215 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-6eb93311-6713-411f-ac06-1d040ea35377 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548" status: 200 len: 1213 microversion: 2.1 time: 0.102206 May 26 15:22:22.967161 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 487/1003] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:22 2022] GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548 => generated 1213 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:23.987298 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-b676c791-5f88-40d8-bcd6-c1a7e9d8a605 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:23.988671 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-b676c791-5f88-40d8-bcd6-c1a7e9d8a605 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: b83cab61-051b-47c0-9f96-1cb01695e548] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:23.999171 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b676c791-5f88-40d8-bcd6-c1a7e9d8a605 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:23.999814 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b676c791-5f88-40d8-bcd6-c1a7e9d8a605 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:24.000795 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b676c791-5f88-40d8-bcd6-c1a7e9d8a605 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:24.001243 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b676c791-5f88-40d8-bcd6-c1a7e9d8a605 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:24.073653 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-b676c791-5f88-40d8-bcd6-c1a7e9d8a605 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:24.088924 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-b676c791-5f88-40d8-bcd6-c1a7e9d8a605 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548" status: 200 len: 1209 microversion: 2.1 time: 0.108737 May 26 15:22:24.089782 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 517/1004] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:23 2022] GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548 => generated 1209 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:25.107603 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-5ad75709-7188-4dfe-9b65-f468a009eeaf tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:25.108213 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-5ad75709-7188-4dfe-9b65-f468a009eeaf tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: b83cab61-051b-47c0-9f96-1cb01695e548] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:25.141089 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5ad75709-7188-4dfe-9b65-f468a009eeaf tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:25.146087 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5ad75709-7188-4dfe-9b65-f468a009eeaf tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:25.147609 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5ad75709-7188-4dfe-9b65-f468a009eeaf tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:25.149640 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5ad75709-7188-4dfe-9b65-f468a009eeaf tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:25.257733 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-5ad75709-7188-4dfe-9b65-f468a009eeaf tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:25.268025 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-5ad75709-7188-4dfe-9b65-f468a009eeaf tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548" status: 200 len: 1209 microversion: 2.1 time: 0.164619 May 26 15:22:25.278641 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 488/1005] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:25 2022] GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548 => generated 1209 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:26.285136 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-a1339e96-8d94-4444-8561-cb72721b143f tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:26.285751 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-a1339e96-8d94-4444-8561-cb72721b143f tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: b83cab61-051b-47c0-9f96-1cb01695e548] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:26.292648 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a1339e96-8d94-4444-8561-cb72721b143f tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:26.293096 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a1339e96-8d94-4444-8561-cb72721b143f tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:26.293913 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a1339e96-8d94-4444-8561-cb72721b143f tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:26.294360 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a1339e96-8d94-4444-8561-cb72721b143f tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:26.374264 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-a1339e96-8d94-4444-8561-cb72721b143f tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:26.382543 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-a1339e96-8d94-4444-8561-cb72721b143f tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548" status: 200 len: 1265 microversion: 2.1 time: 0.101149 May 26 15:22:26.394042 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 518/1006] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:26 2022] GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548 => generated 1265 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:27.403744 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-8ef522eb-ea8e-4e02-b25e-29f7e8e59920 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:27.405136 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-8ef522eb-ea8e-4e02-b25e-29f7e8e59920 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: b83cab61-051b-47c0-9f96-1cb01695e548] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:27.417728 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:27.423931 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8ef522eb-ea8e-4e02-b25e-29f7e8e59920 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:27.426638 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8ef522eb-ea8e-4e02-b25e-29f7e8e59920 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:27.427929 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8ef522eb-ea8e-4e02-b25e-29f7e8e59920 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:27.430669 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8ef522eb-ea8e-4e02-b25e-29f7e8e59920 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:27.449304 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=61 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:27.583859 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-8ef522eb-ea8e-4e02-b25e-29f7e8e59920 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:27.598835 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-8ef522eb-ea8e-4e02-b25e-29f7e8e59920 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548" status: 200 len: 1271 microversion: 2.1 time: 0.198338 May 26 15:22:27.600708 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 489/1007] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:27 2022] GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548 => generated 1271 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:28.620324 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-1e77e8b8-bcc4-49dd-ab56-891fb056e76c tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:28.622608 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-1e77e8b8-bcc4-49dd-ab56-891fb056e76c tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: b83cab61-051b-47c0-9f96-1cb01695e548] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:28.627403 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:28.636102 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1e77e8b8-bcc4-49dd-ab56-891fb056e76c tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:28.638092 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1e77e8b8-bcc4-49dd-ab56-891fb056e76c tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:28.639609 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1e77e8b8-bcc4-49dd-ab56-891fb056e76c tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:28.640529 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1e77e8b8-bcc4-49dd-ab56-891fb056e76c tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:28.656498 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:28.860276 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-1e77e8b8-bcc4-49dd-ab56-891fb056e76c tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:28.887899 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-1e77e8b8-bcc4-49dd-ab56-891fb056e76c tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548" status: 200 len: 1313 microversion: 2.1 time: 0.255176 May 26 15:22:28.898142 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 519/1008] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:28 2022] GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548 => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:29.709901 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-3183c838-0d9b-4dee-b2bf-17c7adc69ed7 req-b52bbfd7-9c35-4002-bb2b-bd9f1952e78d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b83cab61-051b-47c0-9f96-1cb01695e548", "tag": "fa7d6cb9-569b-403a-8059-fbbe45456cba"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:22:29.723174 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-3183c838-0d9b-4dee-b2bf-17c7adc69ed7 req-b52bbfd7-9c35-4002-bb2b-bd9f1952e78d service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:29.723596 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-3183c838-0d9b-4dee-b2bf-17c7adc69ed7 req-b52bbfd7-9c35-4002-bb2b-bd9f1952e78d service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:29.741020 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-3183c838-0d9b-4dee-b2bf-17c7adc69ed7 req-b52bbfd7-9c35-4002-bb2b-bd9f1952e78d service nova] Creating event network-changed:fa7d6cb9-569b-403a-8059-fbbe45456cba for instance b83cab61-051b-47c0-9f96-1cb01695e548 on hv-cinder-84301 May 26 15:22:29.750656 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-3183c838-0d9b-4dee-b2bf-17c7adc69ed7 req-b52bbfd7-9c35-4002-bb2b-bd9f1952e78d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045926 May 26 15:22:29.751409 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 490/1009] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:22:29.906613 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-fc6e5be3-4338-4048-a46d-844b5fb1a5a3 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:29.907275 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-fc6e5be3-4338-4048-a46d-844b5fb1a5a3 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: b83cab61-051b-47c0-9f96-1cb01695e548] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:29.926078 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fc6e5be3-4338-4048-a46d-844b5fb1a5a3 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:29.926841 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fc6e5be3-4338-4048-a46d-844b5fb1a5a3 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:29.928079 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fc6e5be3-4338-4048-a46d-844b5fb1a5a3 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:29.929016 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fc6e5be3-4338-4048-a46d-844b5fb1a5a3 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:30.133127 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-fc6e5be3-4338-4048-a46d-844b5fb1a5a3 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:30.145875 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-fc6e5be3-4338-4048-a46d-844b5fb1a5a3 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548" status: 200 len: 1313 microversion: 2.1 time: 0.243698 May 26 15:22:30.157249 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 520/1010] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:29 2022] GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548 => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:31.165383 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-25e9542b-cace-4a6f-b5e4-33c303e396da tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:31.166078 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-25e9542b-cace-4a6f-b5e4-33c303e396da tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: b83cab61-051b-47c0-9f96-1cb01695e548] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:31.173257 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-25e9542b-cace-4a6f-b5e4-33c303e396da tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:31.173712 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-25e9542b-cace-4a6f-b5e4-33c303e396da tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:31.174489 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-25e9542b-cace-4a6f-b5e4-33c303e396da tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:31.174924 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-25e9542b-cace-4a6f-b5e4-33c303e396da tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:31.384774 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-25e9542b-cace-4a6f-b5e4-33c303e396da tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:31.397040 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-25e9542b-cace-4a6f-b5e4-33c303e396da tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548" status: 200 len: 1313 microversion: 2.1 time: 0.236583 May 26 15:22:31.398200 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 491/1011] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:31 2022] GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548 => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:32.411315 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell0:SELECT=2 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:32.412072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell0:SELECT=6 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:32.416374 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-006ad60a-0c47-432f-bc6f-1a933c65816d tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:32.417201 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-006ad60a-0c47-432f-bc6f-1a933c65816d tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: b83cab61-051b-47c0-9f96-1cb01695e548] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:32.425178 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-006ad60a-0c47-432f-bc6f-1a933c65816d tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:32.425627 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-006ad60a-0c47-432f-bc6f-1a933c65816d tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:32.426579 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-006ad60a-0c47-432f-bc6f-1a933c65816d tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:32.427288 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-006ad60a-0c47-432f-bc6f-1a933c65816d tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:32.583479 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-006ad60a-0c47-432f-bc6f-1a933c65816d tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:32.597147 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-006ad60a-0c47-432f-bc6f-1a933c65816d tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548" status: 200 len: 1313 microversion: 2.1 time: 0.185234 May 26 15:22:32.600763 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 521/1012] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:32 2022] GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548 => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:33.619929 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-5ad2f8d3-20cf-45d4-a8e9-4f76ba62099f tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:33.621234 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-5ad2f8d3-20cf-45d4-a8e9-4f76ba62099f tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: b83cab61-051b-47c0-9f96-1cb01695e548] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:33.628361 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=2 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:33.634201 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5ad2f8d3-20cf-45d4-a8e9-4f76ba62099f tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:33.634872 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5ad2f8d3-20cf-45d4-a8e9-4f76ba62099f tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:33.636470 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5ad2f8d3-20cf-45d4-a8e9-4f76ba62099f tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:33.637837 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5ad2f8d3-20cf-45d4-a8e9-4f76ba62099f tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:33.904703 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-5ad2f8d3-20cf-45d4-a8e9-4f76ba62099f tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:33.918742 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-5ad2f8d3-20cf-45d4-a8e9-4f76ba62099f tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548" status: 200 len: 1313 microversion: 2.1 time: 0.302350 May 26 15:22:33.919817 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 492/1013] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:33 2022] GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548 => generated 1313 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:34.939225 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-4af83921-6bdd-4df7-a36c-e7de487d93ea tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:34.939839 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-4af83921-6bdd-4df7-a36c-e7de487d93ea tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: b83cab61-051b-47c0-9f96-1cb01695e548] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:34.953835 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4af83921-6bdd-4df7-a36c-e7de487d93ea tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:34.954285 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4af83921-6bdd-4df7-a36c-e7de487d93ea tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:34.955072 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4af83921-6bdd-4df7-a36c-e7de487d93ea tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:34.955702 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4af83921-6bdd-4df7-a36c-e7de487d93ea tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:35.149191 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-1fa8be42-844d-43dc-91ad-f5167eea2a5f req-e4206cbd-77ba-4036-b39a-dd0a413f2bd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b83cab61-051b-47c0-9f96-1cb01695e548", "name": "network-vif-plugged", "status": "completed", "tag": "fa7d6cb9-569b-403a-8059-fbbe45456cba"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:22:35.161890 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-4af83921-6bdd-4df7-a36c-e7de487d93ea tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:35.175283 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-4af83921-6bdd-4df7-a36c-e7de487d93ea tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548" status: 200 len: 1313 microversion: 2.1 time: 0.241217 May 26 15:22:35.176817 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 522/1014] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:34 2022] GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548 => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:22:35.183466 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-1fa8be42-844d-43dc-91ad-f5167eea2a5f req-e4206cbd-77ba-4036-b39a-dd0a413f2bd7 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:35.184596 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-1fa8be42-844d-43dc-91ad-f5167eea2a5f req-e4206cbd-77ba-4036-b39a-dd0a413f2bd7 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:35.209743 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-1fa8be42-844d-43dc-91ad-f5167eea2a5f req-e4206cbd-77ba-4036-b39a-dd0a413f2bd7 service nova] Creating event network-vif-plugged:fa7d6cb9-569b-403a-8059-fbbe45456cba for instance b83cab61-051b-47c0-9f96-1cb01695e548 on hv-cinder-84301 May 26 15:22:35.218015 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-1fa8be42-844d-43dc-91ad-f5167eea2a5f req-e4206cbd-77ba-4036-b39a-dd0a413f2bd7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075367 May 26 15:22:35.219759 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 493/1015] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:22:35.288401 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-b799f94c-debd-41c7-b28e-5b5b8715372e tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Action: 'create', calling method: .version_select at 0x7ffb5d6a4940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-545706640", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA9OEnWpup0UNbI2PwPpqI27X8drfnXQLqgoEGSID/Ca++CG2C1fjIqmSD9L9IVETC8bnHQ/lYQxr8h/92CNTA8BEESkwi9YQm4U5IOm6HrKxyTvqi6uHf7JURapueX8Vg=="}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:22:35.304538 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.quota [None req-b799f94c-debd-41c7-b28e-5b5b8715372e tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Getting quotas for project 96bf20387ac24af6b192f071460b9056. Resources: {'key_pairs'} {{(pid=117799) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:22:35.309886 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.quota [None req-b799f94c-debd-41c7-b28e-5b5b8715372e tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Getting quotas for user d836530b3a0c47d287c57ae3915d4371 and project 96bf20387ac24af6b192f071460b9056. Resources: {'key_pairs'} {{(pid=117799) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:22:35.335923 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-b799f94c-debd-41c7-b28e-5b5b8715372e tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.051451 May 26 15:22:35.336960 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 523/1016] 10.222.0.45 () {60 vars in 1158 bytes} [Thu May 26 15:22:35 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:22:35.443336 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-697ba7aa-a535-4431-b807-93351d5af4e8 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1906851236", "imageRef": "fb332b32-3f84-4d2d-b1bd-2a0945ff464e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-545706640", "networks": [{"uuid": "214a22bd-5a75-4a2a-a55a-c810c65fba56"}]}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:22:35.492958 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.network.neutron [None req-697ba7aa-a535-4431-b807-93351d5af4e8 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] validate_networks() for [('214a22bd-5a75-4a2a-a55a-c810c65fba56', None, None, None, None, None)] {{(pid=117798) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:22:35.863357 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-697ba7aa-a535-4431-b807-93351d5af4e8 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Flavor limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:22:35.863784 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-697ba7aa-a535-4431-b807-93351d5af4e8 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Image limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:22:35.864252 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-697ba7aa-a535-4431-b807-93351d5af4e8 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Flavor pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:22:35.864654 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-697ba7aa-a535-4431-b807-93351d5af4e8 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Image pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:22:35.865061 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-697ba7aa-a535-4431-b807-93351d5af4e8 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:22:35.880358 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-697ba7aa-a535-4431-b807-93351d5af4e8 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:35.880358 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-697ba7aa-a535-4431-b807-93351d5af4e8 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:35.883732 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-697ba7aa-a535-4431-b807-93351d5af4e8 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:35.883834 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-697ba7aa-a535-4431-b807-93351d5af4e8 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:35.914008 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-697ba7aa-a535-4431-b807-93351d5af4e8 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Getting quotas for project 96bf20387ac24af6b192f071460b9056. Resources: {'cores', 'ram', 'instances'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:22:35.919909 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-697ba7aa-a535-4431-b807-93351d5af4e8 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Getting quotas for user d836530b3a0c47d287c57ae3915d4371 and project 96bf20387ac24af6b192f071460b9056. Resources: {'cores', 'ram', 'instances'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:22:35.942907 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-697ba7aa-a535-4431-b807-93351d5af4e8 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Going to run 1 instances... {{(pid=117798) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:22:35.946417 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-697ba7aa-a535-4431-b807-93351d5af4e8 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fb332b32-3f84-4d2d-b1bd-2a0945ff464e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:22:36.007985 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-697ba7aa-a535-4431-b807-93351d5af4e8 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.568764 May 26 15:22:36.008746 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 494/1017] 10.222.0.45 () {60 vars in 1146 bytes} [Thu May 26 15:22:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 15:22:36.021269 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-80ddf87d-5fb1-44c3-9440-129a82c3b5e2 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:36.021885 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-80ddf87d-5fb1-44c3-9440-129a82c3b5e2 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:36.077859 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-80ddf87d-5fb1-44c3-9440-129a82c3b5e2 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:36.085110 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-80ddf87d-5fb1-44c3-9440-129a82c3b5e2 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1258 microversion: 2.1 time: 0.068645 May 26 15:22:36.085790 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 524/1018] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:36 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:36.194909 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-2fe45c24-5ab6-4b7a-93a7-98ae54128035 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:36.195481 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-2fe45c24-5ab6-4b7a-93a7-98ae54128035 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: b83cab61-051b-47c0-9f96-1cb01695e548] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:36.203875 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2fe45c24-5ab6-4b7a-93a7-98ae54128035 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:36.204019 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2fe45c24-5ab6-4b7a-93a7-98ae54128035 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:36.204714 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2fe45c24-5ab6-4b7a-93a7-98ae54128035 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:36.205155 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2fe45c24-5ab6-4b7a-93a7-98ae54128035 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:36.372936 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2fe45c24-5ab6-4b7a-93a7-98ae54128035 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:36.390790 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-2fe45c24-5ab6-4b7a-93a7-98ae54128035 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548" status: 200 len: 1313 microversion: 2.1 time: 0.200160 May 26 15:22:36.392790 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 495/1019] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:36 2022] GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548 => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:37.102136 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-69bd6724-7712-4d1c-affe-f86338012b31 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:37.107318 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-69bd6724-7712-4d1c-affe-f86338012b31 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:37.119377 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-69bd6724-7712-4d1c-affe-f86338012b31 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:37.119950 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-69bd6724-7712-4d1c-affe-f86338012b31 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:37.120746 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-69bd6724-7712-4d1c-affe-f86338012b31 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:37.121881 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-69bd6724-7712-4d1c-affe-f86338012b31 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:37.196519 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-69bd6724-7712-4d1c-affe-f86338012b31 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:37.206062 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-69bd6724-7712-4d1c-affe-f86338012b31 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1310 microversion: 2.1 time: 0.107665 May 26 15:22:37.206654 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 525/1020] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:37 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1310 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:22:37.409652 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ba35b15b-f1f3-4b1f-8a82-140295a6d9f9 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:37.410259 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ba35b15b-f1f3-4b1f-8a82-140295a6d9f9 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: b83cab61-051b-47c0-9f96-1cb01695e548] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:37.416857 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ba35b15b-f1f3-4b1f-8a82-140295a6d9f9 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:37.417387 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ba35b15b-f1f3-4b1f-8a82-140295a6d9f9 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:37.419024 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ba35b15b-f1f3-4b1f-8a82-140295a6d9f9 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:37.420333 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ba35b15b-f1f3-4b1f-8a82-140295a6d9f9 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:37.583280 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ba35b15b-f1f3-4b1f-8a82-140295a6d9f9 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:37.591702 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ba35b15b-f1f3-4b1f-8a82-140295a6d9f9 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548" status: 200 len: 1498 microversion: 2.1 time: 0.185802 May 26 15:22:37.592419 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 496/1021] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:37 2022] GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548 => generated 1498 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:38.092563 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-4380245b-6a4c-46ab-9079-372e971ca0cc tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:38.093066 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-4380245b-6a4c-46ab-9079-372e971ca0cc tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: b83cab61-051b-47c0-9f96-1cb01695e548] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:38.100568 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4380245b-6a4c-46ab-9079-372e971ca0cc tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:38.101020 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4380245b-6a4c-46ab-9079-372e971ca0cc tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:38.101873 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4380245b-6a4c-46ab-9079-372e971ca0cc tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:38.102340 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4380245b-6a4c-46ab-9079-372e971ca0cc tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:38.147247 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-4380245b-6a4c-46ab-9079-372e971ca0cc tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: b83cab61-051b-47c0-9f96-1cb01695e548] Going to try to terminate instance {{(pid=117799) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:22:38.228505 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-71a65b20-344c-4781-8ac5-8b6a27fcd63a tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:38.229566 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-71a65b20-344c-4781-8ac5-8b6a27fcd63a tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:38.244911 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-71a65b20-344c-4781-8ac5-8b6a27fcd63a tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:38.248087 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-71a65b20-344c-4781-8ac5-8b6a27fcd63a tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:38.249622 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-71a65b20-344c-4781-8ac5-8b6a27fcd63a tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:38.251692 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-71a65b20-344c-4781-8ac5-8b6a27fcd63a tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:38.272634 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-4380245b-6a4c-46ab-9079-372e971ca0cc tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548" status: 204 len: 0 microversion: 2.1 time: 0.184768 May 26 15:22:38.273277 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 526/1022] 10.222.0.45 () {58 vars in 1238 bytes} [Thu May 26 15:22:38 2022] DELETE /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:22:38.284027 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-939568d4-1c94-48d0-98da-6c88873dec76 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:38.285014 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-939568d4-1c94-48d0-98da-6c88873dec76 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: b83cab61-051b-47c0-9f96-1cb01695e548] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:38.291260 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-939568d4-1c94-48d0-98da-6c88873dec76 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:38.291922 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-939568d4-1c94-48d0-98da-6c88873dec76 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:38.293252 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-939568d4-1c94-48d0-98da-6c88873dec76 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:38.294213 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-939568d4-1c94-48d0-98da-6c88873dec76 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:38.350542 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-71a65b20-344c-4781-8ac5-8b6a27fcd63a tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:38.359506 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-71a65b20-344c-4781-8ac5-8b6a27fcd63a tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1316 microversion: 2.1 time: 0.138816 May 26 15:22:38.362859 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 497/1023] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:38 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1316 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:22:38.486972 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-939568d4-1c94-48d0-98da-6c88873dec76 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:38.497823 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-939568d4-1c94-48d0-98da-6c88873dec76 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548" status: 200 len: 1504 microversion: 2.1 time: 0.218778 May 26 15:22:38.498995 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 527/1024] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:38 2022] GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548 => generated 1504 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:22:39.380301 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-3aa58baf-8167-4a2b-9078-4d6e25112bda tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:39.381009 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-3aa58baf-8167-4a2b-9078-4d6e25112bda tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:39.389072 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3aa58baf-8167-4a2b-9078-4d6e25112bda tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:39.390274 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3aa58baf-8167-4a2b-9078-4d6e25112bda tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:39.391309 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3aa58baf-8167-4a2b-9078-4d6e25112bda tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:39.391963 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3aa58baf-8167-4a2b-9078-4d6e25112bda tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:39.516097 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-9c0b3ae7-cd76-4934-8395-b7a0ba7489df tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:39.516959 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-9c0b3ae7-cd76-4934-8395-b7a0ba7489df tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: b83cab61-051b-47c0-9f96-1cb01695e548] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:39.543916 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9c0b3ae7-cd76-4934-8395-b7a0ba7489df tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:39.544426 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9c0b3ae7-cd76-4934-8395-b7a0ba7489df tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:39.545270 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9c0b3ae7-cd76-4934-8395-b7a0ba7489df tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:39.545705 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9c0b3ae7-cd76-4934-8395-b7a0ba7489df tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:39.581888 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-3aa58baf-8167-4a2b-9078-4d6e25112bda tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:39.589847 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-3aa58baf-8167-4a2b-9078-4d6e25112bda tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1358 microversion: 2.1 time: 0.213401 May 26 15:22:39.591033 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 498/1025] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:39 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1358 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:39.761525 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-9c0b3ae7-cd76-4934-8395-b7a0ba7489df tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:39.770992 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-9c0b3ae7-cd76-4934-8395-b7a0ba7489df tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548" status: 200 len: 1504 microversion: 2.1 time: 0.259526 May 26 15:22:39.772275 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 528/1026] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:39 2022] GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548 => generated 1504 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:22:40.607642 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-71c07093-4667-4b43-af6c-a0c9e57e37df tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:40.608442 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-71c07093-4667-4b43-af6c-a0c9e57e37df tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:40.615580 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-71c07093-4667-4b43-af6c-a0c9e57e37df tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:40.616124 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-71c07093-4667-4b43-af6c-a0c9e57e37df tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:40.617205 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-71c07093-4667-4b43-af6c-a0c9e57e37df tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:40.617654 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-71c07093-4667-4b43-af6c-a0c9e57e37df tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:40.756539 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-71c07093-4667-4b43-af6c-a0c9e57e37df tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:40.764592 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-71c07093-4667-4b43-af6c-a0c9e57e37df tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1358 microversion: 2.1 time: 0.161497 May 26 15:22:40.765436 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 499/1027] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:40 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:40.789063 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-e24da734-8d01-4bca-b00d-821c03aefeb0 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:40.789717 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-e24da734-8d01-4bca-b00d-821c03aefeb0 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: b83cab61-051b-47c0-9f96-1cb01695e548] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:40.797280 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e24da734-8d01-4bca-b00d-821c03aefeb0 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:40.797728 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e24da734-8d01-4bca-b00d-821c03aefeb0 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:40.798507 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e24da734-8d01-4bca-b00d-821c03aefeb0 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:40.798939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e24da734-8d01-4bca-b00d-821c03aefeb0 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:40.945397 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-e24da734-8d01-4bca-b00d-821c03aefeb0 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:40.954451 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-e24da734-8d01-4bca-b00d-821c03aefeb0 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548" status: 200 len: 1504 microversion: 2.1 time: 0.169352 May 26 15:22:40.955035 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 529/1028] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:40 2022] GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548 => generated 1504 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:41.251412 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-9fea863c-975e-4944-8990-edbd31859fe2 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1139796772", "imageRef": "5b5a68b4-38e3-4f05-b97f-4339d6752e34", "flavorRef": "452", "networks": [{"uuid": "44c533c6-3650-4955-91c9-fafb9124ee77"}]}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:22:41.303485 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.network.neutron [None req-9fea863c-975e-4944-8990-edbd31859fe2 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] validate_networks() for [('44c533c6-3650-4955-91c9-fafb9124ee77', None, None, None, None, None)] {{(pid=117798) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:22:41.688254 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-9fea863c-975e-4944-8990-edbd31859fe2 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Flavor limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:22:41.688850 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-9fea863c-975e-4944-8990-edbd31859fe2 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Image limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:22:41.689273 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-9fea863c-975e-4944-8990-edbd31859fe2 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Flavor pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:22:41.689687 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-9fea863c-975e-4944-8990-edbd31859fe2 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Image pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:22:41.690104 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-9fea863c-975e-4944-8990-edbd31859fe2 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:22:41.700881 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9fea863c-975e-4944-8990-edbd31859fe2 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:41.701361 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9fea863c-975e-4944-8990-edbd31859fe2 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:41.702194 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9fea863c-975e-4944-8990-edbd31859fe2 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:41.702632 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9fea863c-975e-4944-8990-edbd31859fe2 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:41.720958 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-9fea863c-975e-4944-8990-edbd31859fe2 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Getting quotas for project ef506c64b2d442d299e2eb16910be975. Resources: {'cores', 'ram', 'instances'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:22:41.725019 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-9fea863c-975e-4944-8990-edbd31859fe2 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Getting quotas for user 65439e25dc88400dac2c457aa5ed139e and project ef506c64b2d442d299e2eb16910be975. Resources: {'cores', 'ram', 'instances'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:22:41.737028 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-9fea863c-975e-4944-8990-edbd31859fe2 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Going to run 1 instances... {{(pid=117798) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:22:41.739474 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-9fea863c-975e-4944-8990-edbd31859fe2 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5b5a68b4-38e3-4f05-b97f-4339d6752e34',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:22:41.783928 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-444a2ae1-a9d5-4ce2-a95b-a3dc8153d381 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:41.784878 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-444a2ae1-a9d5-4ce2-a95b-a3dc8153d381 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:41.786925 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-9fea863c-975e-4944-8990-edbd31859fe2 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.539242 May 26 15:22:41.792721 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 500/1029] 10.222.0.45 () {60 vars in 1146 bytes} [Thu May 26 15:22:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 15:22:41.798262 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-07ae3b41-4546-4a09-bbb2-9c9ee62ef4a1 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:41.799065 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-07ae3b41-4546-4a09-bbb2-9c9ee62ef4a1 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:41.801951 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-444a2ae1-a9d5-4ce2-a95b-a3dc8153d381 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:41.803697 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-444a2ae1-a9d5-4ce2-a95b-a3dc8153d381 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:41.805188 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-444a2ae1-a9d5-4ce2-a95b-a3dc8153d381 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:41.811509 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-444a2ae1-a9d5-4ce2-a95b-a3dc8153d381 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:41.864996 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-07ae3b41-4546-4a09-bbb2-9c9ee62ef4a1 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:41.879968 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-07ae3b41-4546-4a09-bbb2-9c9ee62ef4a1 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19" status: 200 len: 1219 microversion: 2.1 time: 0.085537 May 26 15:22:41.881302 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 501/1030] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:41 2022] GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:41.972342 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1329bb47-5624-49b1-a9c4-afa4f0fec63e tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:41.973022 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1329bb47-5624-49b1-a9c4-afa4f0fec63e tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: b83cab61-051b-47c0-9f96-1cb01695e548] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:41.982127 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1329bb47-5624-49b1-a9c4-afa4f0fec63e tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:41.982582 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1329bb47-5624-49b1-a9c4-afa4f0fec63e tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:41.983576 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1329bb47-5624-49b1-a9c4-afa4f0fec63e tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:41.984027 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1329bb47-5624-49b1-a9c4-afa4f0fec63e tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:42.008667 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-444a2ae1-a9d5-4ce2-a95b-a3dc8153d381 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:42.022573 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-444a2ae1-a9d5-4ce2-a95b-a3dc8153d381 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1358 microversion: 2.1 time: 0.238777 May 26 15:22:42.023880 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 530/1031] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:41 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:42.165657 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1329bb47-5624-49b1-a9c4-afa4f0fec63e tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:42.176013 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1329bb47-5624-49b1-a9c4-afa4f0fec63e tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548" status: 200 len: 1504 microversion: 2.1 time: 0.207240 May 26 15:22:42.187527 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 502/1032] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:41 2022] GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548 => generated 1504 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:22:42.899614 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-852ef6ee-68a4-4fae-a482-a43e0f78ac7e tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:42.900315 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-852ef6ee-68a4-4fae-a482-a43e0f78ac7e tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:42.907522 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-852ef6ee-68a4-4fae-a482-a43e0f78ac7e tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:42.908249 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-852ef6ee-68a4-4fae-a482-a43e0f78ac7e tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:42.909207 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-852ef6ee-68a4-4fae-a482-a43e0f78ac7e tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:42.909639 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-852ef6ee-68a4-4fae-a482-a43e0f78ac7e tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:42.987287 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-852ef6ee-68a4-4fae-a482-a43e0f78ac7e tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:42.994891 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-852ef6ee-68a4-4fae-a482-a43e0f78ac7e tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19" status: 200 len: 1223 microversion: 2.1 time: 0.099069 May 26 15:22:42.995499 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 531/1033] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:42 2022] GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19 => generated 1223 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:43.040939 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e4cb9f81-5fe0-4937-9b7f-04e4c3849bb8 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:43.041620 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e4cb9f81-5fe0-4937-9b7f-04e4c3849bb8 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:43.048928 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e4cb9f81-5fe0-4937-9b7f-04e4c3849bb8 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:43.049375 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e4cb9f81-5fe0-4937-9b7f-04e4c3849bb8 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:43.050149 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e4cb9f81-5fe0-4937-9b7f-04e4c3849bb8 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:43.050586 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e4cb9f81-5fe0-4937-9b7f-04e4c3849bb8 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:43.194228 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e4cb9f81-5fe0-4937-9b7f-04e4c3849bb8 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:43.196076 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-8ad916b9-d694-41ca-89a1-c70126d93c31 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:43.197292 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-8ad916b9-d694-41ca-89a1-c70126d93c31 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: b83cab61-051b-47c0-9f96-1cb01695e548] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:43.205093 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8ad916b9-d694-41ca-89a1-c70126d93c31 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:43.205796 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8ad916b9-d694-41ca-89a1-c70126d93c31 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:43.206846 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8ad916b9-d694-41ca-89a1-c70126d93c31 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:43.207537 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-8ad916b9-d694-41ca-89a1-c70126d93c31 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:43.212533 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e4cb9f81-5fe0-4937-9b7f-04e4c3849bb8 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1358 microversion: 2.1 time: 0.174624 May 26 15:22:43.221825 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 503/1034] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:43 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:43.381571 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-8ad916b9-d694-41ca-89a1-c70126d93c31 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:43.390468 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-8ad916b9-d694-41ca-89a1-c70126d93c31 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548" status: 200 len: 1504 microversion: 2.1 time: 0.198473 May 26 15:22:43.391054 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 532/1035] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:43 2022] GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548 => generated 1504 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:22:44.012677 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-bc0359fd-57e4-4829-a662-01ac0ce4ee82 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:44.013283 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-bc0359fd-57e4-4829-a662-01ac0ce4ee82 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:44.020451 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bc0359fd-57e4-4829-a662-01ac0ce4ee82 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:44.021021 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bc0359fd-57e4-4829-a662-01ac0ce4ee82 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:44.021904 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bc0359fd-57e4-4829-a662-01ac0ce4ee82 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:44.022412 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bc0359fd-57e4-4829-a662-01ac0ce4ee82 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:44.095313 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-bc0359fd-57e4-4829-a662-01ac0ce4ee82 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:44.104107 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-bc0359fd-57e4-4829-a662-01ac0ce4ee82 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19" status: 200 len: 1223 microversion: 2.1 time: 0.096037 May 26 15:22:44.104942 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 504/1036] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:44 2022] GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19 => generated 1223 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:44.231931 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-b7d7b976-3d51-4980-b73f-79709918921e tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:44.232545 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-b7d7b976-3d51-4980-b73f-79709918921e tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:44.239113 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b7d7b976-3d51-4980-b73f-79709918921e tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:44.239574 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b7d7b976-3d51-4980-b73f-79709918921e tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:44.240346 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b7d7b976-3d51-4980-b73f-79709918921e tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:44.240783 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b7d7b976-3d51-4980-b73f-79709918921e tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:44.382593 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-b7d7b976-3d51-4980-b73f-79709918921e tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:44.391578 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-b7d7b976-3d51-4980-b73f-79709918921e tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1358 microversion: 2.1 time: 0.163962 May 26 15:22:44.392425 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 533/1037] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:44 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:44.408747 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-bc79290d-e8ed-4cf0-91ae-5d4304cb7454 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:44.409568 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-bc79290d-e8ed-4cf0-91ae-5d4304cb7454 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: b83cab61-051b-47c0-9f96-1cb01695e548] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:44.417249 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bc79290d-e8ed-4cf0-91ae-5d4304cb7454 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:44.418133 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bc79290d-e8ed-4cf0-91ae-5d4304cb7454 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:44.419237 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bc79290d-e8ed-4cf0-91ae-5d4304cb7454 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:44.419740 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bc79290d-e8ed-4cf0-91ae-5d4304cb7454 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:44.565613 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-bc79290d-e8ed-4cf0-91ae-5d4304cb7454 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:44.579186 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-bc79290d-e8ed-4cf0-91ae-5d4304cb7454 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548" status: 200 len: 1504 microversion: 2.1 time: 0.174696 May 26 15:22:44.579718 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 505/1038] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:44 2022] GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548 => generated 1504 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:45.121795 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-41d6488b-68db-4391-bd4a-c2f44ebaf44d tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:45.122872 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-41d6488b-68db-4391-bd4a-c2f44ebaf44d tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:45.129567 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-41d6488b-68db-4391-bd4a-c2f44ebaf44d tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:45.130432 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-41d6488b-68db-4391-bd4a-c2f44ebaf44d tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:45.131377 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-41d6488b-68db-4391-bd4a-c2f44ebaf44d tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:45.131957 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-41d6488b-68db-4391-bd4a-c2f44ebaf44d tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:45.201868 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-41d6488b-68db-4391-bd4a-c2f44ebaf44d tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:45.209991 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-41d6488b-68db-4391-bd4a-c2f44ebaf44d tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19" status: 200 len: 1223 microversion: 2.1 time: 0.092031 May 26 15:22:45.210555 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 534/1039] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:45 2022] GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19 => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:45.409401 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-2857fa9c-cff4-41b9-886a-af7c594c6027 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:45.409993 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-2857fa9c-cff4-41b9-886a-af7c594c6027 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:45.416526 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2857fa9c-cff4-41b9-886a-af7c594c6027 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:45.416970 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2857fa9c-cff4-41b9-886a-af7c594c6027 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:45.417737 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2857fa9c-cff4-41b9-886a-af7c594c6027 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:45.418396 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2857fa9c-cff4-41b9-886a-af7c594c6027 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:45.559311 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2857fa9c-cff4-41b9-886a-af7c594c6027 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:45.566986 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-2857fa9c-cff4-41b9-886a-af7c594c6027 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1358 microversion: 2.1 time: 0.161477 May 26 15:22:45.567592 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 506/1040] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:45 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:45.597727 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-2b52fa68-f7cd-4c0b-aca2-8a55eb93d522 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:45.598454 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-2b52fa68-f7cd-4c0b-aca2-8a55eb93d522 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: b83cab61-051b-47c0-9f96-1cb01695e548] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:45.606034 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2b52fa68-f7cd-4c0b-aca2-8a55eb93d522 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:45.606484 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2b52fa68-f7cd-4c0b-aca2-8a55eb93d522 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:45.607315 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2b52fa68-f7cd-4c0b-aca2-8a55eb93d522 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:45.607751 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2b52fa68-f7cd-4c0b-aca2-8a55eb93d522 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:45.751985 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-2b52fa68-f7cd-4c0b-aca2-8a55eb93d522 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:45.759693 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-2b52fa68-f7cd-4c0b-aca2-8a55eb93d522 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548" status: 200 len: 1504 microversion: 2.1 time: 0.166692 May 26 15:22:45.760258 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 535/1041] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:45 2022] GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:46.227649 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c344ba83-6367-4323-8eac-2f908b21a0fa tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:46.228256 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c344ba83-6367-4323-8eac-2f908b21a0fa tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:46.235731 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c344ba83-6367-4323-8eac-2f908b21a0fa tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:46.236175 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c344ba83-6367-4323-8eac-2f908b21a0fa tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:46.236939 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c344ba83-6367-4323-8eac-2f908b21a0fa tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:46.237368 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c344ba83-6367-4323-8eac-2f908b21a0fa tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:46.306775 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c344ba83-6367-4323-8eac-2f908b21a0fa tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:46.315146 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c344ba83-6367-4323-8eac-2f908b21a0fa tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19" status: 200 len: 1223 microversion: 2.1 time: 0.091296 May 26 15:22:46.315735 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 507/1042] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:46 2022] GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19 => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:22:46.585044 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-6f512e8d-0485-4240-b936-c83483e698e9 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:46.585573 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-6f512e8d-0485-4240-b936-c83483e698e9 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:46.587549 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell0:SELECT=6 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:46.594202 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6f512e8d-0485-4240-b936-c83483e698e9 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:46.594774 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6f512e8d-0485-4240-b936-c83483e698e9 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:46.595593 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6f512e8d-0485-4240-b936-c83483e698e9 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:46.596113 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6f512e8d-0485-4240-b936-c83483e698e9 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:46.599723 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:46.744059 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-6f512e8d-0485-4240-b936-c83483e698e9 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:46.753361 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-6f512e8d-0485-4240-b936-c83483e698e9 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1358 microversion: 2.1 time: 0.172153 May 26 15:22:46.754488 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 536/1043] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:46 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:46.778780 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d1f96d98-97f5-4046-bf50-70567638df6e tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:46.779552 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-d1f96d98-97f5-4046-bf50-70567638df6e tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: b83cab61-051b-47c0-9f96-1cb01695e548] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:46.787107 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d1f96d98-97f5-4046-bf50-70567638df6e tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:46.787573 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d1f96d98-97f5-4046-bf50-70567638df6e tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:46.788339 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d1f96d98-97f5-4046-bf50-70567638df6e tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:46.788980 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d1f96d98-97f5-4046-bf50-70567638df6e tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:46.958840 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d1f96d98-97f5-4046-bf50-70567638df6e tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:46.969225 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-d1f96d98-97f5-4046-bf50-70567638df6e tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548" status: 200 len: 1504 microversion: 2.1 time: 0.195840 May 26 15:22:46.969795 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 508/1044] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:46 2022] GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548 => generated 1504 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:22:47.333295 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-a478eadb-2d41-4903-8939-73206da98bf5 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:47.333902 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-a478eadb-2d41-4903-8939-73206da98bf5 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:47.341978 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a478eadb-2d41-4903-8939-73206da98bf5 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:47.342505 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a478eadb-2d41-4903-8939-73206da98bf5 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:47.343623 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a478eadb-2d41-4903-8939-73206da98bf5 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:47.344074 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a478eadb-2d41-4903-8939-73206da98bf5 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:47.414713 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-a478eadb-2d41-4903-8939-73206da98bf5 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:47.422501 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-a478eadb-2d41-4903-8939-73206da98bf5 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19" status: 200 len: 1223 microversion: 2.1 time: 0.093045 May 26 15:22:47.423103 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 537/1045] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:47 2022] GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19 => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:47.770997 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d4c296d4-0de1-40f6-8126-faea402afa17 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:47.772420 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-d4c296d4-0de1-40f6-8126-faea402afa17 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:47.787130 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d4c296d4-0de1-40f6-8126-faea402afa17 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:47.788450 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d4c296d4-0de1-40f6-8126-faea402afa17 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:47.789282 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d4c296d4-0de1-40f6-8126-faea402afa17 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:47.789712 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d4c296d4-0de1-40f6-8126-faea402afa17 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:47.813176 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=100 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:47.941467 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d4c296d4-0de1-40f6-8126-faea402afa17 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:47.949235 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-d4c296d4-0de1-40f6-8126-faea402afa17 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1358 microversion: 2.1 time: 0.182090 May 26 15:22:47.950020 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 509/1046] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:47 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:47.987222 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-2ee227d2-539b-4958-9d8c-dae99f424eab tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:47.988184 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-2ee227d2-539b-4958-9d8c-dae99f424eab tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: b83cab61-051b-47c0-9f96-1cb01695e548] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:47.994989 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2ee227d2-539b-4958-9d8c-dae99f424eab tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:47.995469 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2ee227d2-539b-4958-9d8c-dae99f424eab tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:47.996565 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2ee227d2-539b-4958-9d8c-dae99f424eab tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:47.997142 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-2ee227d2-539b-4958-9d8c-dae99f424eab tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:48.144729 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-2ee227d2-539b-4958-9d8c-dae99f424eab tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:48.154297 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-2ee227d2-539b-4958-9d8c-dae99f424eab tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548" status: 200 len: 1504 microversion: 2.1 time: 0.170952 May 26 15:22:48.154895 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 538/1047] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:47 2022] GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548 => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:48.439782 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1b5cf3a8-ac74-4455-b479-bdad7a738598 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:48.440475 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1b5cf3a8-ac74-4455-b479-bdad7a738598 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:48.448130 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1b5cf3a8-ac74-4455-b479-bdad7a738598 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:48.448592 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1b5cf3a8-ac74-4455-b479-bdad7a738598 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:48.449940 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1b5cf3a8-ac74-4455-b479-bdad7a738598 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:48.450525 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1b5cf3a8-ac74-4455-b479-bdad7a738598 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:48.516409 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1b5cf3a8-ac74-4455-b479-bdad7a738598 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:48.524037 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1b5cf3a8-ac74-4455-b479-bdad7a738598 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19" status: 200 len: 1223 microversion: 2.1 time: 0.088219 May 26 15:22:48.524598 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 510/1048] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:48 2022] GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19 => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:48.966125 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-19903373-a6f6-4a91-bc0f-2eff08322e6a tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:48.966687 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-19903373-a6f6-4a91-bc0f-2eff08322e6a tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:48.972735 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-19903373-a6f6-4a91-bc0f-2eff08322e6a tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:48.973186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-19903373-a6f6-4a91-bc0f-2eff08322e6a tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:48.973956 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-19903373-a6f6-4a91-bc0f-2eff08322e6a tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:48.974407 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-19903373-a6f6-4a91-bc0f-2eff08322e6a tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:49.106645 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-19903373-a6f6-4a91-bc0f-2eff08322e6a tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:49.114496 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-19903373-a6f6-4a91-bc0f-2eff08322e6a tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1358 microversion: 2.1 time: 0.152515 May 26 15:22:49.115108 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 539/1049] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:48 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:49.172366 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-eb1a2e6c-7e5c-484b-b47a-d0f42c7c5125 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:49.172973 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-eb1a2e6c-7e5c-484b-b47a-d0f42c7c5125 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: b83cab61-051b-47c0-9f96-1cb01695e548] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:49.179432 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-eb1a2e6c-7e5c-484b-b47a-d0f42c7c5125 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:49.179880 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-eb1a2e6c-7e5c-484b-b47a-d0f42c7c5125 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:49.180941 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-eb1a2e6c-7e5c-484b-b47a-d0f42c7c5125 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:49.181384 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-eb1a2e6c-7e5c-484b-b47a-d0f42c7c5125 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:49.312272 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-eb1a2e6c-7e5c-484b-b47a-d0f42c7c5125 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:49.320099 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-eb1a2e6c-7e5c-484b-b47a-d0f42c7c5125 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548" status: 200 len: 1504 microversion: 2.1 time: 0.152101 May 26 15:22:49.320675 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 511/1050] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:49 2022] GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:49.541412 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-bdb7d22f-21ec-4a9b-aedd-5fb73c061205 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:49.542028 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-bdb7d22f-21ec-4a9b-aedd-5fb73c061205 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:49.548668 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-bdb7d22f-21ec-4a9b-aedd-5fb73c061205 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:49.549100 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-bdb7d22f-21ec-4a9b-aedd-5fb73c061205 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:49.549885 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-bdb7d22f-21ec-4a9b-aedd-5fb73c061205 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:49.550314 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-bdb7d22f-21ec-4a9b-aedd-5fb73c061205 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:49.613364 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-bdb7d22f-21ec-4a9b-aedd-5fb73c061205 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:49.620630 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-bdb7d22f-21ec-4a9b-aedd-5fb73c061205 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19" status: 200 len: 1223 microversion: 2.1 time: 0.083127 May 26 15:22:49.621715 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 540/1051] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:49 2022] GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:50.132085 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-4371303a-b757-4109-92ee-3ab3cc0d6016 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:50.132678 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-4371303a-b757-4109-92ee-3ab3cc0d6016 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:50.139014 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4371303a-b757-4109-92ee-3ab3cc0d6016 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:50.139488 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4371303a-b757-4109-92ee-3ab3cc0d6016 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:50.140498 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4371303a-b757-4109-92ee-3ab3cc0d6016 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:50.140924 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4371303a-b757-4109-92ee-3ab3cc0d6016 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:50.272694 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-4371303a-b757-4109-92ee-3ab3cc0d6016 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:50.280770 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-4371303a-b757-4109-92ee-3ab3cc0d6016 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1358 microversion: 2.1 time: 0.152540 May 26 15:22:50.281346 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 512/1052] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:50 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:50.337751 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-1d7294c3-dad8-4ac1-8aef-97484da05a19 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:50.338352 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-1d7294c3-dad8-4ac1-8aef-97484da05a19 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: b83cab61-051b-47c0-9f96-1cb01695e548] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:50.345881 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1d7294c3-dad8-4ac1-8aef-97484da05a19 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:50.346330 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1d7294c3-dad8-4ac1-8aef-97484da05a19 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:50.347111 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1d7294c3-dad8-4ac1-8aef-97484da05a19 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:50.347557 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1d7294c3-dad8-4ac1-8aef-97484da05a19 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:50.478045 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-1d7294c3-dad8-4ac1-8aef-97484da05a19 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:50.486327 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-1d7294c3-dad8-4ac1-8aef-97484da05a19 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548" status: 200 len: 1504 microversion: 2.1 time: 0.152677 May 26 15:22:50.486896 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 541/1053] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:50 2022] GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:50.639349 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-fb91f7f5-8637-4607-b5ef-e931e4865646 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:50.640154 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-fb91f7f5-8637-4607-b5ef-e931e4865646 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:50.646435 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fb91f7f5-8637-4607-b5ef-e931e4865646 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:50.646882 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fb91f7f5-8637-4607-b5ef-e931e4865646 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:50.647679 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fb91f7f5-8637-4607-b5ef-e931e4865646 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:50.648115 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fb91f7f5-8637-4607-b5ef-e931e4865646 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:50.711283 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-fb91f7f5-8637-4607-b5ef-e931e4865646 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:50.719322 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-fb91f7f5-8637-4607-b5ef-e931e4865646 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19" status: 200 len: 1223 microversion: 2.1 time: 0.084953 May 26 15:22:50.719895 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 513/1054] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:50 2022] GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:51.298141 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-bb33939f-8a72-443e-9f4e-cdc9d92c3810 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:51.298690 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-bb33939f-8a72-443e-9f4e-cdc9d92c3810 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:51.304890 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-bb33939f-8a72-443e-9f4e-cdc9d92c3810 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:51.305347 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-bb33939f-8a72-443e-9f4e-cdc9d92c3810 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:51.306116 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-bb33939f-8a72-443e-9f4e-cdc9d92c3810 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:51.306565 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-bb33939f-8a72-443e-9f4e-cdc9d92c3810 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:51.434445 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-bb33939f-8a72-443e-9f4e-cdc9d92c3810 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:51.441914 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-bb33939f-8a72-443e-9f4e-cdc9d92c3810 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1358 microversion: 2.1 time: 0.147681 May 26 15:22:51.442475 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 542/1055] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:51 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:51.503259 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e10bf9d1-124b-4df9-9d0b-9bc19626a850 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:51.503874 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e10bf9d1-124b-4df9-9d0b-9bc19626a850 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: b83cab61-051b-47c0-9f96-1cb01695e548] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:51.510418 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e10bf9d1-124b-4df9-9d0b-9bc19626a850 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:51.510897 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e10bf9d1-124b-4df9-9d0b-9bc19626a850 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:51.512529 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e10bf9d1-124b-4df9-9d0b-9bc19626a850 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:51.513029 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e10bf9d1-124b-4df9-9d0b-9bc19626a850 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:51.644964 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-e10bf9d1-124b-4df9-9d0b-9bc19626a850 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:51.653897 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e10bf9d1-124b-4df9-9d0b-9bc19626a850 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548" status: 200 len: 1504 microversion: 2.1 time: 0.154371 May 26 15:22:51.654481 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 514/1056] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:51 2022] GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:51.735645 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-483c5924-8973-4d4c-8f2f-30db3c2297d7 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:51.736349 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-483c5924-8973-4d4c-8f2f-30db3c2297d7 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:51.742584 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-483c5924-8973-4d4c-8f2f-30db3c2297d7 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:51.743154 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-483c5924-8973-4d4c-8f2f-30db3c2297d7 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:51.743996 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-483c5924-8973-4d4c-8f2f-30db3c2297d7 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:51.744545 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-483c5924-8973-4d4c-8f2f-30db3c2297d7 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:51.812409 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-483c5924-8973-4d4c-8f2f-30db3c2297d7 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:51.821733 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-483c5924-8973-4d4c-8f2f-30db3c2297d7 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19" status: 200 len: 1223 microversion: 2.1 time: 0.090082 May 26 15:22:51.832466 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 543/1057] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:51 2022] GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19 => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:52.411230 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=4 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:52.412249 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=14 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:52.460018 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-cf043727-db42-47d0-8ffa-2d260474c323 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:52.461217 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-cf043727-db42-47d0-8ffa-2d260474c323 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:52.468439 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-cf043727-db42-47d0-8ffa-2d260474c323 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:52.468891 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-cf043727-db42-47d0-8ffa-2d260474c323 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:52.470033 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-cf043727-db42-47d0-8ffa-2d260474c323 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:52.470481 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-cf043727-db42-47d0-8ffa-2d260474c323 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:52.615252 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-cf043727-db42-47d0-8ffa-2d260474c323 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:52.625082 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-cf043727-db42-47d0-8ffa-2d260474c323 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1358 microversion: 2.1 time: 0.169081 May 26 15:22:52.625920 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 544/1058] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:52 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:22:52.637915 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-57baaf3e-7ecf-4c8c-a2d6-9ec607ddd291 req-9ab69021-7f2b-41ae-9595-9f54d85cd7fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b83cab61-051b-47c0-9f96-1cb01695e548", "name": "network-vif-deleted", "tag": "fa7d6cb9-569b-403a-8059-fbbe45456cba"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:22:52.648259 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-57baaf3e-7ecf-4c8c-a2d6-9ec607ddd291 req-9ab69021-7f2b-41ae-9595-9f54d85cd7fc service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:52.649076 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-57baaf3e-7ecf-4c8c-a2d6-9ec607ddd291 req-9ab69021-7f2b-41ae-9595-9f54d85cd7fc service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:52.672082 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-57baaf3e-7ecf-4c8c-a2d6-9ec607ddd291 req-9ab69021-7f2b-41ae-9595-9f54d85cd7fc service nova] Creating event network-vif-deleted:fa7d6cb9-569b-403a-8059-fbbe45456cba for instance b83cab61-051b-47c0-9f96-1cb01695e548 on hv-cinder-84301 May 26 15:22:52.674874 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-1575aa77-b821-4c52-9576-81c0359b0405 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:52.675632 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-1575aa77-b821-4c52-9576-81c0359b0405 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: b83cab61-051b-47c0-9f96-1cb01695e548] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:52.681543 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-57baaf3e-7ecf-4c8c-a2d6-9ec607ddd291 req-9ab69021-7f2b-41ae-9595-9f54d85cd7fc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.274570 May 26 15:22:52.686130 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 515/1059] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:22:52.686409 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1575aa77-b821-4c52-9576-81c0359b0405 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:52.687051 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1575aa77-b821-4c52-9576-81c0359b0405 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:52.688172 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1575aa77-b821-4c52-9576-81c0359b0405 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:52.689008 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1575aa77-b821-4c52-9576-81c0359b0405 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:52.724911 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1575aa77-b821-4c52-9576-81c0359b0405 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:52.725358 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1575aa77-b821-4c52-9576-81c0359b0405 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:52.725807 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.objects.instance [None req-1575aa77-b821-4c52-9576-81c0359b0405 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lazy-loading 'fault' on Instance uuid b83cab61-051b-47c0-9f96-1cb01695e548 {{(pid=117799) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:22:52.771065 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-1575aa77-b821-4c52-9576-81c0359b0405 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ab9cfa5d346b08a2c9070656fa62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275e360373049f996bc3679e7f921a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:52.780317 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-1575aa77-b821-4c52-9576-81c0359b0405 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548" status: 200 len: 1303 microversion: 2.1 time: 0.112805 May 26 15:22:52.780982 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 545/1060] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:52 2022] GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548 => generated 1303 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:22:52.840958 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-86a22541-8f21-45bb-a624-92d12b425779 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:52.841641 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-86a22541-8f21-45bb-a624-92d12b425779 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:52.848066 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-86a22541-8f21-45bb-a624-92d12b425779 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:52.848505 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-86a22541-8f21-45bb-a624-92d12b425779 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:52.849268 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-86a22541-8f21-45bb-a624-92d12b425779 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:52.849696 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-86a22541-8f21-45bb-a624-92d12b425779 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:52.889871 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-dfee494e-3ecc-4b64-b05a-d1bc044934be req-504547e2-0664-4296-b0a5-d456ff066a7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "974b6652-5d82-41a1-be5d-9a3adc0f7cae", "tag": "1c375646-f237-4900-866d-7a3da3589b33"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:22:52.904447 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-dfee494e-3ecc-4b64-b05a-d1bc044934be req-504547e2-0664-4296-b0a5-d456ff066a7e service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:52.904971 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-dfee494e-3ecc-4b64-b05a-d1bc044934be req-504547e2-0664-4296-b0a5-d456ff066a7e service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:52.919821 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-dfee494e-3ecc-4b64-b05a-d1bc044934be req-504547e2-0664-4296-b0a5-d456ff066a7e service nova] Creating event network-changed:1c375646-f237-4900-866d-7a3da3589b33 for instance 974b6652-5d82-41a1-be5d-9a3adc0f7cae on hv-cinder-84301 May 26 15:22:52.925887 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-86a22541-8f21-45bb-a624-92d12b425779 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:52.927601 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-dfee494e-3ecc-4b64-b05a-d1bc044934be req-504547e2-0664-4296-b0a5-d456ff066a7e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041849 May 26 15:22:52.928897 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 546/1061] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:22:52.935747 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-86a22541-8f21-45bb-a624-92d12b425779 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19" status: 200 len: 1277 microversion: 2.1 time: 0.099041 May 26 15:22:52.936606 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 516/1062] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:52 2022] GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19 => generated 1277 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:22:53.644773 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-fcf1207a-ec85-446d-a7c8-165a68668a69 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:53.645769 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-fcf1207a-ec85-446d-a7c8-165a68668a69 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:53.653825 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fcf1207a-ec85-446d-a7c8-165a68668a69 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:53.654294 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fcf1207a-ec85-446d-a7c8-165a68668a69 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:53.655055 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fcf1207a-ec85-446d-a7c8-165a68668a69 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:53.655517 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fcf1207a-ec85-446d-a7c8-165a68668a69 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:53.786556 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-fcf1207a-ec85-446d-a7c8-165a68668a69 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:53.796623 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-fcf1207a-ec85-446d-a7c8-165a68668a69 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1358 microversion: 2.1 time: 0.157113 May 26 15:22:53.797463 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 547/1063] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:53 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:53.802120 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e0616291-243e-4fad-a34e-668752e09590 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:53.802744 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-e0616291-243e-4fad-a34e-668752e09590 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] [instance: b83cab61-051b-47c0-9f96-1cb01695e548] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:53.814495 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e0616291-243e-4fad-a34e-668752e09590 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:53.814960 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e0616291-243e-4fad-a34e-668752e09590 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:53.816453 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e0616291-243e-4fad-a34e-668752e09590 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:53.816897 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-e0616291-243e-4fad-a34e-668752e09590 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:53.831913 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-e0616291-243e-4fad-a34e-668752e09590 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] HTTP exception thrown: Instance b83cab61-051b-47c0-9f96-1cb01695e548 could not be found. May 26 15:22:53.833586 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e0616291-243e-4fad-a34e-668752e09590 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Request method failure captured: May 26 15:22:53.833586 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: request: GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548 HTTP/1.1 May 26 15:22:53.833586 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept: application/json May 26 15:22:53.833586 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity May 26 15:22:53.833586 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Connection: close May 26 15:22:53.833586 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Length: 0 May 26 15:22:53.833586 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Type: application/json May 26 15:22:53.833586 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Host: 10.222.0.45 May 26 15:22:53.833586 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None May 26 15:22:53.833586 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 May 26 15:22:53.833586 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABij5sSVDdXFpTKikxONXETMU3bqp5yLQWVd__734XF4fmB4HI6gFAY7A54PzwYtQXpATVJFT3LXcvnx94Jyo41gmjuXCpsWlzLEjL6okoyv1FBU5k8Ecs-xXts_IZMkSKiI8FwYki0N5H-A3YgYLHQko1gc42Tiw3JC1RQxHGh0jEobFs May 26 15:22:53.833586 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Id: None May 26 15:22:53.833586 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Name: None May 26 15:22:53.833586 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed May 26 15:22:53.833586 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True May 26 15:22:53.833586 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default May 26 15:22:53.833586 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default May 26 15:22:53.833586 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Id: 4275e360373049f996bc3679e7f921a3 May 26 15:22:53.833586 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-VolumesActionsTest-1293108570 May 26 15:22:53.833586 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Role: reader,member May 26 15:22:53.833586 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Roles: reader,member May 26 15:22:53.835396 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4275e360373049f996bc3679e7f921a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4275e360373049f996bc3679e7f921a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4275e360373049f996bc3679e7f921a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4275e360373049f996bc3679e7f921a3"}]}] May 26 15:22:53.835396 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-VolumesActionsTest-1293108570 May 26 15:22:53.835396 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Id: 4275e360373049f996bc3679e7f921a3 May 26 15:22:53.835396 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-VolumesActionsTest-1293108570 May 26 15:22:53.835396 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User: tempest-VolumesActionsTest-1293108570-project May 26 15:22:53.835396 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default May 26 15:22:53.835396 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default May 26 15:22:53.835396 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Id: ac5ab9cfa5d346b08a2c9070656fa62a May 26 15:22:53.835396 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-VolumesActionsTest-1293108570-project May 26 15:22:53.835396 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: method: > May 26 15:22:53.835396 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: exception: Instance b83cab61-051b-47c0-9f96-1cb01695e548 could not be found. May 26 15:22:53.835396 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: action_args: {'id': 'b83cab61-051b-47c0-9f96-1cb01695e548'} May 26 15:22:53.836956 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:22:53.836956 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:22:53.836956 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:22:53.836956 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:22:53.836956 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:22:53.836956 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:22:53.836956 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:22:53.836956 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:22:53.836956 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:22:53.836956 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:22:53.836956 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b83cab61-051b-47c0-9f96-1cb01695e548 could not be found. May 26 15:22:53.836956 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:22:53.836956 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:22:53.836956 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:22:53.836956 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:22:53.836956 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:22:53.836956 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:22:53.836956 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:22:53.836956 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:22:53.836956 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:22:53.838371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:22:53.838371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:22:53.838371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:22:53.838371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:22:53.838371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:22:53.838371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:22:53.838371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:22:53.838371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b83cab61-051b-47c0-9f96-1cb01695e548 could not be found. May 26 15:22:53.838371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:22:53.838371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:22:53.838371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:22:53.838371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:22:53.838371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:22:53.838371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:22:53.838371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:22:53.838371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:22:53.838371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b83cab61-051b-47c0-9f96-1cb01695e548 could not be found. May 26 15:22:53.838371 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:22:53.840550 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-e0616291-243e-4fad-a34e-668752e09590 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] Returning 404 to user: Instance b83cab61-051b-47c0-9f96-1cb01695e548 could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:22:53.840550 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-e0616291-243e-4fad-a34e-668752e09590 tempest-VolumesActionsTest-1293108570 tempest-VolumesActionsTest-1293108570-project] 10.222.0.45 "GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548" status: 404 len: 111 microversion: 2.1 time: 0.039510 May 26 15:22:53.840550 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 517/1064] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:53 2022] GET /compute/v2.1/servers/b83cab61-051b-47c0-9f96-1cb01695e548 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 15:22:53.957323 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-a6415fa6-3424-4090-bd88-eb887811f22e tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:53.958249 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-a6415fa6-3424-4090-bd88-eb887811f22e tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:53.974921 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a6415fa6-3424-4090-bd88-eb887811f22e tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:53.975405 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a6415fa6-3424-4090-bd88-eb887811f22e tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:53.976297 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a6415fa6-3424-4090-bd88-eb887811f22e tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:53.976922 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a6415fa6-3424-4090-bd88-eb887811f22e tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:54.143009 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-a6415fa6-3424-4090-bd88-eb887811f22e tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:54.151305 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-a6415fa6-3424-4090-bd88-eb887811f22e tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19" status: 200 len: 1319 microversion: 2.1 time: 0.201133 May 26 15:22:54.152548 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 548/1065] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:53 2022] GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19 => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:54.814368 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-7683ab2f-6167-4d52-a593-31a00c61651f tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:54.815016 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-7683ab2f-6167-4d52-a593-31a00c61651f tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:54.821525 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7683ab2f-6167-4d52-a593-31a00c61651f tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:54.821984 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7683ab2f-6167-4d52-a593-31a00c61651f tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:54.822752 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7683ab2f-6167-4d52-a593-31a00c61651f tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:54.823217 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7683ab2f-6167-4d52-a593-31a00c61651f tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:54.967210 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7683ab2f-6167-4d52-a593-31a00c61651f tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:54.974804 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-7683ab2f-6167-4d52-a593-31a00c61651f tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1358 microversion: 2.1 time: 0.164304 May 26 15:22:54.975415 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 518/1066] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:54 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:55.170309 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-1a78c9a4-a0a2-4be8-82a1-47c86272cd1f tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:55.170918 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-1a78c9a4-a0a2-4be8-82a1-47c86272cd1f tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:55.177505 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1a78c9a4-a0a2-4be8-82a1-47c86272cd1f tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:55.177950 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1a78c9a4-a0a2-4be8-82a1-47c86272cd1f tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:55.178711 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1a78c9a4-a0a2-4be8-82a1-47c86272cd1f tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:55.179166 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1a78c9a4-a0a2-4be8-82a1-47c86272cd1f tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:55.204433 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-7f77aa53-6bfe-4015-9088-c6e632efde49 req-3bebdb33-17ef-4b1d-b677-8e36688616a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41f4f35e-512c-4b29-b7a7-cc8b38ab3a19", "tag": "7b251101-69e7-4bf0-a53f-1fbaa6678c48"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:22:55.220890 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-7f77aa53-6bfe-4015-9088-c6e632efde49 req-3bebdb33-17ef-4b1d-b677-8e36688616a5 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:55.221397 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-7f77aa53-6bfe-4015-9088-c6e632efde49 req-3bebdb33-17ef-4b1d-b677-8e36688616a5 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:55.236196 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-7f77aa53-6bfe-4015-9088-c6e632efde49 req-3bebdb33-17ef-4b1d-b677-8e36688616a5 service nova] Creating event network-changed:7b251101-69e7-4bf0-a53f-1fbaa6678c48 for instance 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19 on hv-cinder-84301 May 26 15:22:55.240962 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-7f77aa53-6bfe-4015-9088-c6e632efde49 req-3bebdb33-17ef-4b1d-b677-8e36688616a5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040364 May 26 15:22:55.241559 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 519/1067] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:22:55.320631 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-1a78c9a4-a0a2-4be8-82a1-47c86272cd1f tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:55.328817 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-1a78c9a4-a0a2-4be8-82a1-47c86272cd1f tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19" status: 200 len: 1319 microversion: 2.1 time: 0.163672 May 26 15:22:55.329392 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 549/1068] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:55 2022] GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:55.993482 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-91df87b7-6f0f-457c-9e2a-2ab0cd1c13a9 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:55.994131 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-91df87b7-6f0f-457c-9e2a-2ab0cd1c13a9 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:56.000805 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-91df87b7-6f0f-457c-9e2a-2ab0cd1c13a9 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:56.001251 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-91df87b7-6f0f-457c-9e2a-2ab0cd1c13a9 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:56.002039 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-91df87b7-6f0f-457c-9e2a-2ab0cd1c13a9 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:56.002455 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-91df87b7-6f0f-457c-9e2a-2ab0cd1c13a9 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:56.133428 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-91df87b7-6f0f-457c-9e2a-2ab0cd1c13a9 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:56.141683 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-91df87b7-6f0f-457c-9e2a-2ab0cd1c13a9 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1358 microversion: 2.1 time: 0.153081 May 26 15:22:56.142243 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 520/1069] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:55 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:56.345875 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-ddef2985-1007-4df4-be29-51f1e5799d9b tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:56.346474 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-ddef2985-1007-4df4-be29-51f1e5799d9b tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:56.353014 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ddef2985-1007-4df4-be29-51f1e5799d9b tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:56.353447 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ddef2985-1007-4df4-be29-51f1e5799d9b tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:56.354212 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ddef2985-1007-4df4-be29-51f1e5799d9b tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:56.354645 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ddef2985-1007-4df4-be29-51f1e5799d9b tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:56.483056 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-ddef2985-1007-4df4-be29-51f1e5799d9b tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:56.490575 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-ddef2985-1007-4df4-be29-51f1e5799d9b tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19" status: 200 len: 1319 microversion: 2.1 time: 0.148574 May 26 15:22:56.491162 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 550/1070] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:56 2022] GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:57.159189 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-9be90adf-ad12-421c-933b-7aef65d7bddc tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:57.159796 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-9be90adf-ad12-421c-933b-7aef65d7bddc tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:57.166224 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9be90adf-ad12-421c-933b-7aef65d7bddc tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:57.166662 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9be90adf-ad12-421c-933b-7aef65d7bddc tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:57.168135 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9be90adf-ad12-421c-933b-7aef65d7bddc tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:57.168994 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9be90adf-ad12-421c-933b-7aef65d7bddc tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:57.300735 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-9be90adf-ad12-421c-933b-7aef65d7bddc tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:57.308409 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-9be90adf-ad12-421c-933b-7aef65d7bddc tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1358 microversion: 2.1 time: 0.153021 May 26 15:22:57.309152 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 521/1071] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:57 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:57.508330 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-f6027b62-9a07-4495-9a34-58134d8c2e40 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:57.508881 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-f6027b62-9a07-4495-9a34-58134d8c2e40 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:57.516363 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f6027b62-9a07-4495-9a34-58134d8c2e40 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:57.516808 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f6027b62-9a07-4495-9a34-58134d8c2e40 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:57.517571 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f6027b62-9a07-4495-9a34-58134d8c2e40 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:57.517999 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f6027b62-9a07-4495-9a34-58134d8c2e40 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:57.646122 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-f6027b62-9a07-4495-9a34-58134d8c2e40 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:57.653793 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-f6027b62-9a07-4495-9a34-58134d8c2e40 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19" status: 200 len: 1319 microversion: 2.1 time: 0.149510 May 26 15:22:57.654351 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 551/1072] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:57 2022] GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:58.325629 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a3690125-4cc1-4e4e-800f-16c3dfad2fb5 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:58.326177 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a3690125-4cc1-4e4e-800f-16c3dfad2fb5 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:58.328822 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:58.334419 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a3690125-4cc1-4e4e-800f-16c3dfad2fb5 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:58.334898 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a3690125-4cc1-4e4e-800f-16c3dfad2fb5 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:58.335769 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a3690125-4cc1-4e4e-800f-16c3dfad2fb5 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:58.336268 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a3690125-4cc1-4e4e-800f-16c3dfad2fb5 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:58.468741 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a3690125-4cc1-4e4e-800f-16c3dfad2fb5 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:58.476145 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a3690125-4cc1-4e4e-800f-16c3dfad2fb5 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1358 microversion: 2.1 time: 0.155369 May 26 15:22:58.476720 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 522/1073] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:58 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:58.671239 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-ee6d4464-ea64-44ee-a525-e299e9d250ca tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:58.671818 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-ee6d4464-ea64-44ee-a525-e299e9d250ca tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:58.674144 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:58.679642 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ee6d4464-ea64-44ee-a525-e299e9d250ca tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:58.680088 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ee6d4464-ea64-44ee-a525-e299e9d250ca tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:58.680851 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ee6d4464-ea64-44ee-a525-e299e9d250ca tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:58.681284 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ee6d4464-ea64-44ee-a525-e299e9d250ca tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:58.812481 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-ee6d4464-ea64-44ee-a525-e299e9d250ca tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:58.819922 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-ee6d4464-ea64-44ee-a525-e299e9d250ca tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19" status: 200 len: 1319 microversion: 2.1 time: 0.152796 May 26 15:22:58.820526 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 552/1074] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:58 2022] GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:59.493801 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-fd68be36-58f3-4c28-a488-50c202fd3b1d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:59.494420 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-fd68be36-58f3-4c28-a488-50c202fd3b1d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:59.503704 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fd68be36-58f3-4c28-a488-50c202fd3b1d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:59.504158 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fd68be36-58f3-4c28-a488-50c202fd3b1d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:59.505020 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fd68be36-58f3-4c28-a488-50c202fd3b1d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:59.505524 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fd68be36-58f3-4c28-a488-50c202fd3b1d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:59.649067 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-fd68be36-58f3-4c28-a488-50c202fd3b1d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:59.658517 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-fd68be36-58f3-4c28-a488-50c202fd3b1d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1358 microversion: 2.1 time: 0.168612 May 26 15:22:59.659668 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 523/1075] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:59 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:22:59.837817 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-3feac9eb-d781-4ba8-8ba2-855eca234e98 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:59.838431 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-3feac9eb-d781-4ba8-8ba2-855eca234e98 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:59.847029 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-3feac9eb-d781-4ba8-8ba2-855eca234e98 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:59.848142 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-3feac9eb-d781-4ba8-8ba2-855eca234e98 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:59.849533 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-3feac9eb-d781-4ba8-8ba2-855eca234e98 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:59.850213 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-3feac9eb-d781-4ba8-8ba2-855eca234e98 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:59.856788 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=100 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:23:00.066848 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-3feac9eb-d781-4ba8-8ba2-855eca234e98 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:00.075835 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-3feac9eb-d781-4ba8-8ba2-855eca234e98 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19" status: 200 len: 1319 microversion: 2.1 time: 0.242218 May 26 15:23:00.076417 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 553/1076] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:22:59 2022] GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19 => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:00.676304 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a9414933-7167-4044-b2ec-43e2cc031957 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:00.677728 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a9414933-7167-4044-b2ec-43e2cc031957 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:00.685686 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a9414933-7167-4044-b2ec-43e2cc031957 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:00.686266 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a9414933-7167-4044-b2ec-43e2cc031957 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:00.687437 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a9414933-7167-4044-b2ec-43e2cc031957 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:00.688238 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a9414933-7167-4044-b2ec-43e2cc031957 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:00.847324 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a9414933-7167-4044-b2ec-43e2cc031957 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:00.856809 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a9414933-7167-4044-b2ec-43e2cc031957 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1358 microversion: 2.1 time: 0.184289 May 26 15:23:00.857502 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 524/1077] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:00 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:23:01.093679 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-19edef5e-581d-4f25-b557-9ab3dee094a5 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:01.094293 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-19edef5e-581d-4f25-b557-9ab3dee094a5 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:01.101933 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-19edef5e-581d-4f25-b557-9ab3dee094a5 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:01.102648 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-19edef5e-581d-4f25-b557-9ab3dee094a5 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:01.103635 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-19edef5e-581d-4f25-b557-9ab3dee094a5 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:01.104229 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-19edef5e-581d-4f25-b557-9ab3dee094a5 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:01.609429 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-19edef5e-581d-4f25-b557-9ab3dee094a5 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:01.623730 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-19edef5e-581d-4f25-b557-9ab3dee094a5 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19" status: 200 len: 1319 microversion: 2.1 time: 0.534194 May 26 15:23:01.624992 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 554/1078] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:01 2022] GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19 => generated 1319 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:01.874703 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-8918443c-c5b7-4600-9a2f-10e901e8867a tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:01.875348 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-8918443c-c5b7-4600-9a2f-10e901e8867a tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:01.883237 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8918443c-c5b7-4600-9a2f-10e901e8867a tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:01.884025 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8918443c-c5b7-4600-9a2f-10e901e8867a tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:01.884869 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8918443c-c5b7-4600-9a2f-10e901e8867a tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:01.885305 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8918443c-c5b7-4600-9a2f-10e901e8867a tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:02.026912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-8918443c-c5b7-4600-9a2f-10e901e8867a tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:02.038677 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-8918443c-c5b7-4600-9a2f-10e901e8867a tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1358 microversion: 2.1 time: 0.168626 May 26 15:23:02.039426 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 525/1079] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:01 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:23:02.644943 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-93b18ca5-6379-4f4d-a235-82f68d672363 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:02.646561 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-93b18ca5-6379-4f4d-a235-82f68d672363 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:02.655229 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-93b18ca5-6379-4f4d-a235-82f68d672363 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:02.655673 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-93b18ca5-6379-4f4d-a235-82f68d672363 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:02.656452 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-93b18ca5-6379-4f4d-a235-82f68d672363 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:02.656889 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-93b18ca5-6379-4f4d-a235-82f68d672363 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:02.816750 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-93b18ca5-6379-4f4d-a235-82f68d672363 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:02.840520 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-93b18ca5-6379-4f4d-a235-82f68d672363 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19" status: 200 len: 1319 microversion: 2.1 time: 0.201368 May 26 15:23:02.849972 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 555/1080] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:02 2022] GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:03.059127 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-23ca3486-6c17-431a-b1e5-cd66af081a40 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:03.060793 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-23ca3486-6c17-431a-b1e5-cd66af081a40 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:03.081455 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-23ca3486-6c17-431a-b1e5-cd66af081a40 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:03.081913 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-23ca3486-6c17-431a-b1e5-cd66af081a40 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:03.082883 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-23ca3486-6c17-431a-b1e5-cd66af081a40 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:03.083663 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-23ca3486-6c17-431a-b1e5-cd66af081a40 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:03.260290 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-23ca3486-6c17-431a-b1e5-cd66af081a40 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:03.269474 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-23ca3486-6c17-431a-b1e5-cd66af081a40 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1358 microversion: 2.1 time: 0.215215 May 26 15:23:03.279702 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 526/1081] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:03 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1358 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:03.858477 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-7d871540-8a05-4d4d-badc-99a1611c7a44 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:03.859810 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-7d871540-8a05-4d4d-badc-99a1611c7a44 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:03.872317 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7d871540-8a05-4d4d-badc-99a1611c7a44 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:03.872772 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7d871540-8a05-4d4d-badc-99a1611c7a44 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:03.873576 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7d871540-8a05-4d4d-badc-99a1611c7a44 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:03.874014 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7d871540-8a05-4d4d-badc-99a1611c7a44 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:04.031776 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-7d871540-8a05-4d4d-badc-99a1611c7a44 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:04.048913 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-7d871540-8a05-4d4d-badc-99a1611c7a44 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19" status: 200 len: 1319 microversion: 2.1 time: 0.194794 May 26 15:23:04.049842 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 556/1082] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:03 2022] GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19 => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:04.287474 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-0afdc14a-1a71-4a02-ac45-62cdeecabb83 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:04.289007 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-0afdc14a-1a71-4a02-ac45-62cdeecabb83 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:04.297285 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0afdc14a-1a71-4a02-ac45-62cdeecabb83 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:04.297847 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0afdc14a-1a71-4a02-ac45-62cdeecabb83 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:04.298806 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0afdc14a-1a71-4a02-ac45-62cdeecabb83 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:04.299373 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0afdc14a-1a71-4a02-ac45-62cdeecabb83 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:04.444799 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-0afdc14a-1a71-4a02-ac45-62cdeecabb83 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:04.454562 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-0afdc14a-1a71-4a02-ac45-62cdeecabb83 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1358 microversion: 2.1 time: 0.171215 May 26 15:23:04.455597 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 527/1083] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:04 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:05.070599 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-0307bc33-a25d-4f64-bffe-2babb88ec854 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:05.071467 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-0307bc33-a25d-4f64-bffe-2babb88ec854 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:05.079055 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0307bc33-a25d-4f64-bffe-2babb88ec854 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:05.079668 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0307bc33-a25d-4f64-bffe-2babb88ec854 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:05.085185 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-855dfb7e-ef61-409d-98ba-868bacd4eb03 req-49bbb2f6-40ca-4ac7-910d-8ad678a21f78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "974b6652-5d82-41a1-be5d-9a3adc0f7cae", "name": "network-vif-plugged", "status": "completed", "tag": "1c375646-f237-4900-866d-7a3da3589b33"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:23:05.090484 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0307bc33-a25d-4f64-bffe-2babb88ec854 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:05.094598 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-855dfb7e-ef61-409d-98ba-868bacd4eb03 req-49bbb2f6-40ca-4ac7-910d-8ad678a21f78 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:05.095341 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0307bc33-a25d-4f64-bffe-2babb88ec854 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:05.100359 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-855dfb7e-ef61-409d-98ba-868bacd4eb03 req-49bbb2f6-40ca-4ac7-910d-8ad678a21f78 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:05.116369 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=100 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:23:05.126212 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-855dfb7e-ef61-409d-98ba-868bacd4eb03 req-49bbb2f6-40ca-4ac7-910d-8ad678a21f78 service nova] Creating event network-vif-plugged:1c375646-f237-4900-866d-7a3da3589b33 for instance 974b6652-5d82-41a1-be5d-9a3adc0f7cae on hv-cinder-84301 May 26 15:23:05.139370 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-855dfb7e-ef61-409d-98ba-868bacd4eb03 req-49bbb2f6-40ca-4ac7-910d-8ad678a21f78 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057722 May 26 15:23:05.143141 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 528/1084] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:23:05.304286 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-0307bc33-a25d-4f64-bffe-2babb88ec854 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:05.325123 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-0307bc33-a25d-4f64-bffe-2babb88ec854 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19" status: 200 len: 1319 microversion: 2.1 time: 0.256344 May 26 15:23:05.326010 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 557/1085] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:05 2022] GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:05.473119 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-33d5eb0e-8e9f-4777-a2ab-bd6a926e0c55 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:05.473956 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-33d5eb0e-8e9f-4777-a2ab-bd6a926e0c55 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:05.483725 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-33d5eb0e-8e9f-4777-a2ab-bd6a926e0c55 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:05.484177 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-33d5eb0e-8e9f-4777-a2ab-bd6a926e0c55 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:05.485455 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-33d5eb0e-8e9f-4777-a2ab-bd6a926e0c55 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:05.486135 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-33d5eb0e-8e9f-4777-a2ab-bd6a926e0c55 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:05.650176 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-33d5eb0e-8e9f-4777-a2ab-bd6a926e0c55 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:05.660867 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-33d5eb0e-8e9f-4777-a2ab-bd6a926e0c55 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1358 microversion: 2.1 time: 0.191950 May 26 15:23:05.661866 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 529/1086] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:05 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:06.343243 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-41b29710-98a5-43bb-b8f3-5f2445b7e683 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:06.344718 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-41b29710-98a5-43bb-b8f3-5f2445b7e683 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:06.353474 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-41b29710-98a5-43bb-b8f3-5f2445b7e683 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:06.354588 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-41b29710-98a5-43bb-b8f3-5f2445b7e683 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:06.356655 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-41b29710-98a5-43bb-b8f3-5f2445b7e683 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:06.357151 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-41b29710-98a5-43bb-b8f3-5f2445b7e683 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:06.514000 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-41b29710-98a5-43bb-b8f3-5f2445b7e683 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:06.522174 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-41b29710-98a5-43bb-b8f3-5f2445b7e683 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19" status: 200 len: 1319 microversion: 2.1 time: 0.182846 May 26 15:23:06.523011 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 558/1087] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:06 2022] GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:06.679344 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-dc0bf84a-337a-40f7-a550-e3daab7ba1c2 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:06.680579 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-dc0bf84a-337a-40f7-a550-e3daab7ba1c2 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:06.687851 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dc0bf84a-337a-40f7-a550-e3daab7ba1c2 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:06.688292 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dc0bf84a-337a-40f7-a550-e3daab7ba1c2 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:06.689249 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dc0bf84a-337a-40f7-a550-e3daab7ba1c2 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:06.689858 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dc0bf84a-337a-40f7-a550-e3daab7ba1c2 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:06.835372 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-dc0bf84a-337a-40f7-a550-e3daab7ba1c2 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:06.844128 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-dc0bf84a-337a-40f7-a550-e3daab7ba1c2 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1358 microversion: 2.1 time: 0.168732 May 26 15:23:06.845281 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 530/1088] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:06 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:07.540631 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-5e4d379b-9671-4312-8fd0-a655fd3c24af tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:07.541255 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-5e4d379b-9671-4312-8fd0-a655fd3c24af tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:07.549830 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5e4d379b-9671-4312-8fd0-a655fd3c24af tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:07.550286 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5e4d379b-9671-4312-8fd0-a655fd3c24af tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:07.551387 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5e4d379b-9671-4312-8fd0-a655fd3c24af tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:07.552145 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5e4d379b-9671-4312-8fd0-a655fd3c24af tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:07.736296 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-5e4d379b-9671-4312-8fd0-a655fd3c24af tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:07.745047 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-5e4d379b-9671-4312-8fd0-a655fd3c24af tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19" status: 200 len: 1319 microversion: 2.1 time: 0.208498 May 26 15:23:07.747125 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 559/1089] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:07 2022] GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:07.863702 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-39657b55-9f9b-4c86-84a6-005799991e6f tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:07.864336 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-39657b55-9f9b-4c86-84a6-005799991e6f tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:07.874489 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-39657b55-9f9b-4c86-84a6-005799991e6f tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:07.875042 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-39657b55-9f9b-4c86-84a6-005799991e6f tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:07.876075 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-39657b55-9f9b-4c86-84a6-005799991e6f tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:07.876670 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-39657b55-9f9b-4c86-84a6-005799991e6f tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:08.044341 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-39657b55-9f9b-4c86-84a6-005799991e6f tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:08.052235 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-39657b55-9f9b-4c86-84a6-005799991e6f tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1548 microversion: 2.1 time: 0.193774 May 26 15:23:08.053501 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 531/1090] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:07 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1548 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:23:08.069437 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-87bc2d3a-133b-4d0f-9d76-b6de852e89a0 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:08.070051 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-87bc2d3a-133b-4d0f-9d76-b6de852e89a0 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:08.076920 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-87bc2d3a-133b-4d0f-9d76-b6de852e89a0 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:08.077416 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-87bc2d3a-133b-4d0f-9d76-b6de852e89a0 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:08.078300 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-87bc2d3a-133b-4d0f-9d76-b6de852e89a0 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:08.078778 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-87bc2d3a-133b-4d0f-9d76-b6de852e89a0 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:08.221574 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-87bc2d3a-133b-4d0f-9d76-b6de852e89a0 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:08.229518 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-87bc2d3a-133b-4d0f-9d76-b6de852e89a0 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1548 microversion: 2.1 time: 0.163978 May 26 15:23:08.230481 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 560/1091] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:08 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:08.246914 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-65ecf444-cf42-4d85-9c92-c04ab4fd2ede tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:08.250615 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-65ecf444-cf42-4d85-9c92-c04ab4fd2ede tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:08.251452 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-65ecf444-cf42-4d85-9c92-c04ab4fd2ede tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Searching by: {'deleted': False, 'project_id': '96bf20387ac24af6b192f071460b9056'} {{(pid=117798) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 26 15:23:08.258652 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-65ecf444-cf42-4d85-9c92-c04ab4fd2ede tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:08.259838 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-65ecf444-cf42-4d85-9c92-c04ab4fd2ede tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:08.260656 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-65ecf444-cf42-4d85-9c92-c04ab4fd2ede tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:08.261200 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-65ecf444-cf42-4d85-9c92-c04ab4fd2ede tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:08.372420 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.multi_cell_list [None req-65ecf444-cf42-4d85-9c92-c04ab4fd2ede tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117798) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 26 15:23:08.496457 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-65ecf444-cf42-4d85-9c92-c04ab4fd2ede tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.253145 May 26 15:23:08.497300 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 532/1092] 10.222.0.45 () {58 vars in 1124 bytes} [Thu May 26 15:23:08 2022] GET /compute/v2.1/servers => generated 343 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:23:08.507982 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-e36faee0-e5c6-42ab-bb33-1f08548c2885 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:08.508616 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-e36faee0-e5c6-42ab-bb33-1f08548c2885 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:08.516224 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e36faee0-e5c6-42ab-bb33-1f08548c2885 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:08.516718 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e36faee0-e5c6-42ab-bb33-1f08548c2885 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:08.517599 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e36faee0-e5c6-42ab-bb33-1f08548c2885 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:08.518103 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e36faee0-e5c6-42ab-bb33-1f08548c2885 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:08.668372 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-e36faee0-e5c6-42ab-bb33-1f08548c2885 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:08.679273 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-e36faee0-e5c6-42ab-bb33-1f08548c2885 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1548 microversion: 2.1 time: 0.175466 May 26 15:23:08.680248 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 561/1093] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:08 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1548 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:08.766323 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-6e0cabfb-ea25-4ce4-ae41-8726dd5e00a1 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:08.768167 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-6e0cabfb-ea25-4ce4-ae41-8726dd5e00a1 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:08.775787 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6e0cabfb-ea25-4ce4-ae41-8726dd5e00a1 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:08.776355 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6e0cabfb-ea25-4ce4-ae41-8726dd5e00a1 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:08.777714 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6e0cabfb-ea25-4ce4-ae41-8726dd5e00a1 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:08.778260 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-6e0cabfb-ea25-4ce4-ae41-8726dd5e00a1 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:08.952826 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-6e0cabfb-ea25-4ce4-ae41-8726dd5e00a1 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:08.962840 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-6e0cabfb-ea25-4ce4-ae41-8726dd5e00a1 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19" status: 200 len: 1319 microversion: 2.1 time: 0.204800 May 26 15:23:08.965793 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 533/1094] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:08 2022] GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:09.109880 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-00ac73cd-61b5-4519-9f4a-809303c6d16a req-a90f8211-5a7e-4436-b015-04688c0ffdf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41f4f35e-512c-4b29-b7a7-cc8b38ab3a19", "name": "network-vif-plugged", "status": "completed", "tag": "7b251101-69e7-4bf0-a53f-1fbaa6678c48"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:23:09.127027 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-00ac73cd-61b5-4519-9f4a-809303c6d16a req-a90f8211-5a7e-4436-b015-04688c0ffdf1 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:09.128482 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-00ac73cd-61b5-4519-9f4a-809303c6d16a req-a90f8211-5a7e-4436-b015-04688c0ffdf1 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:09.157715 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-00ac73cd-61b5-4519-9f4a-809303c6d16a req-a90f8211-5a7e-4436-b015-04688c0ffdf1 service nova] Creating event network-vif-plugged:7b251101-69e7-4bf0-a53f-1fbaa6678c48 for instance 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19 on hv-cinder-84301 May 26 15:23:09.163862 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-00ac73cd-61b5-4519-9f4a-809303c6d16a req-a90f8211-5a7e-4436-b015-04688c0ffdf1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058187 May 26 15:23:09.166010 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 562/1095] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:23:09.984588 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-11790970-dee9-4fec-bfe4-1135fdfa4d97 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:09.985848 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-11790970-dee9-4fec-bfe4-1135fdfa4d97 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:09.992775 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-11790970-dee9-4fec-bfe4-1135fdfa4d97 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:09.993222 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-11790970-dee9-4fec-bfe4-1135fdfa4d97 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:09.994171 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-11790970-dee9-4fec-bfe4-1135fdfa4d97 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:09.994610 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-11790970-dee9-4fec-bfe4-1135fdfa4d97 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:10.167912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-11790970-dee9-4fec-bfe4-1135fdfa4d97 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:10.186745 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-11790970-dee9-4fec-bfe4-1135fdfa4d97 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19" status: 200 len: 1319 microversion: 2.1 time: 0.206609 May 26 15:23:10.188078 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 534/1096] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:09 2022] GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19 => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:23:10.388930 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-c19daf95-4930-4704-98fd-cb8ce504741d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14d610e6-392a-4d75-8224-9ac089c4eebc"}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:23:10.391335 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-c19daf95-4930-4704-98fd-cb8ce504741d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:10.398084 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c19daf95-4930-4704-98fd-cb8ce504741d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:10.398623 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c19daf95-4930-4704-98fd-cb8ce504741d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:10.399523 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c19daf95-4930-4704-98fd-cb8ce504741d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:10.399962 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c19daf95-4930-4704-98fd-cb8ce504741d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:10.952294 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-c19daf95-4930-4704-98fd-cb8ce504741d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "POST /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.568136 May 26 15:23:10.953383 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 563/1097] 10.222.0.45 () {60 vars in 1322 bytes} [Thu May 26 15:23:10 2022] POST /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae/os-volume_attachments => generated 194 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:23:11.205518 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-d7a0e906-023b-47cb-a093-6f580e2aeb08 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:11.207029 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-d7a0e906-023b-47cb-a093-6f580e2aeb08 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:11.215628 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d7a0e906-023b-47cb-a093-6f580e2aeb08 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:11.216292 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d7a0e906-023b-47cb-a093-6f580e2aeb08 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:11.217341 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d7a0e906-023b-47cb-a093-6f580e2aeb08 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:11.218070 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-d7a0e906-023b-47cb-a093-6f580e2aeb08 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:11.374838 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-d7a0e906-023b-47cb-a093-6f580e2aeb08 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:11.384071 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-d7a0e906-023b-47cb-a093-6f580e2aeb08 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19" status: 200 len: 1508 microversion: 2.1 time: 0.182482 May 26 15:23:11.384932 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 535/1098] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:11 2022] GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19 => generated 1508 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:19.646026 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-c8cfc4e2-3063-409a-b112-59d190b55695 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:19.646842 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-c8cfc4e2-3063-409a-b112-59d190b55695 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:19.653968 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c8cfc4e2-3063-409a-b112-59d190b55695 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:19.654362 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c8cfc4e2-3063-409a-b112-59d190b55695 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:19.655238 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c8cfc4e2-3063-409a-b112-59d190b55695 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:19.655668 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c8cfc4e2-3063-409a-b112-59d190b55695 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:19.803448 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-c8cfc4e2-3063-409a-b112-59d190b55695 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:19.813044 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-c8cfc4e2-3063-409a-b112-59d190b55695 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1594 microversion: 2.1 time: 0.172423 May 26 15:23:19.813888 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 564/1099] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:19 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1594 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:21.548547 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-2d86df15-1f27-4fed-9027-aaa69af106ed tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-227247782", "imageRef": "5b5a68b4-38e3-4f05-b97f-4339d6752e34", "flavorRef": "452"}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:23:21.554797 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=2 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:23:21.555537 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=27 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:23:21.556263 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=45 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:23:21.611874 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.network.neutron [None req-2d86df15-1f27-4fed-9027-aaa69af106ed tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] validate_networks() for None {{(pid=117798) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:23:21.904755 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-2d86df15-1f27-4fed-9027-aaa69af106ed tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Flavor limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:23:21.905258 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-2d86df15-1f27-4fed-9027-aaa69af106ed tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Image limits 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:23:21.905776 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-2d86df15-1f27-4fed-9027-aaa69af106ed tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Flavor pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:23:21.906222 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-2d86df15-1f27-4fed-9027-aaa69af106ed tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Image pref 0:0:0 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:23:21.906666 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.virt.hardware [None req-2d86df15-1f27-4fed-9027-aaa69af106ed tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:23:21.916554 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2d86df15-1f27-4fed-9027-aaa69af106ed tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:21.917350 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2d86df15-1f27-4fed-9027-aaa69af106ed tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:21.918261 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2d86df15-1f27-4fed-9027-aaa69af106ed tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:21.918709 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2d86df15-1f27-4fed-9027-aaa69af106ed tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:21.937812 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-2d86df15-1f27-4fed-9027-aaa69af106ed tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Getting quotas for project b7fa8cd6f5944d3d9e3ac1d8e6b73924. Resources: {'cores', 'ram', 'instances'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:23:21.941832 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.quota [None req-2d86df15-1f27-4fed-9027-aaa69af106ed tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Getting quotas for user f61296c57f8643a3a1e8bacf33274c69 and project b7fa8cd6f5944d3d9e3ac1d8e6b73924. Resources: {'cores', 'ram', 'instances'} {{(pid=117798) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:23:21.954427 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-2d86df15-1f27-4fed-9027-aaa69af106ed tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Going to run 1 instances... {{(pid=117798) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:23:21.956784 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-2d86df15-1f27-4fed-9027-aaa69af106ed tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] [instance: f2bc2950-8f82-443b-9b33-b0e71a2ec3ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5b5a68b4-38e3-4f05-b97f-4339d6752e34',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:23:22.011958 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-2d86df15-1f27-4fed-9027-aaa69af106ed tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.467196 May 26 15:23:22.017856 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 536/1100] 10.222.0.45 () {60 vars in 1146 bytes} [Thu May 26 15:23:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 469 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 15:23:22.025001 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-2a736ca7-eb9e-44d9-bd12-7e58f0210d35 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:22.025704 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-2a736ca7-eb9e-44d9-bd12-7e58f0210d35 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] [instance: f2bc2950-8f82-443b-9b33-b0e71a2ec3ef] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:22.046346 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-8d785ea0-e3dd-4bf5-9c73-d88aeee256ac req-07931767-8b52-4056-a233-e175c5ad530e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "974b6652-5d82-41a1-be5d-9a3adc0f7cae", "tag": "1c375646-f237-4900-866d-7a3da3589b33"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:23:22.056782 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-8d785ea0-e3dd-4bf5-9c73-d88aeee256ac req-07931767-8b52-4056-a233-e175c5ad530e service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:22.057227 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-8d785ea0-e3dd-4bf5-9c73-d88aeee256ac req-07931767-8b52-4056-a233-e175c5ad530e service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:22.080713 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-8d785ea0-e3dd-4bf5-9c73-d88aeee256ac req-07931767-8b52-4056-a233-e175c5ad530e service nova] Creating event network-changed:1c375646-f237-4900-866d-7a3da3589b33 for instance 974b6652-5d82-41a1-be5d-9a3adc0f7cae on hv-cinder-84301 May 26 15:23:22.086671 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-8d785ea0-e3dd-4bf5-9c73-d88aeee256ac req-07931767-8b52-4056-a233-e175c5ad530e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045839 May 26 15:23:22.089869 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 537/1101] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:23:22.132893 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-2a736ca7-eb9e-44d9-bd12-7e58f0210d35 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61296c57f8643a3a1e8bacf33274c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7fa8cd6f5944d3d9e3ac1d8e6b73924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:22.143247 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-2a736ca7-eb9e-44d9-bd12-7e58f0210d35 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] 10.222.0.45 "GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef" status: 200 len: 1214 microversion: 2.1 time: 0.123736 May 26 15:23:22.144504 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 565/1102] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:22 2022] GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef => generated 1214 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:23.163383 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-907756a8-e3e3-49ff-afb8-532ce2ca0525 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:23.164087 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-907756a8-e3e3-49ff-afb8-532ce2ca0525 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] [instance: f2bc2950-8f82-443b-9b33-b0e71a2ec3ef] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:23.171998 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-907756a8-e3e3-49ff-afb8-532ce2ca0525 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:23.172450 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-907756a8-e3e3-49ff-afb8-532ce2ca0525 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:23.173303 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-907756a8-e3e3-49ff-afb8-532ce2ca0525 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:23.173770 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-907756a8-e3e3-49ff-afb8-532ce2ca0525 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:23.242095 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-0521e428-cbf4-4c71-8729-5b1b7ee8430d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-20606018"}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:23:23.242638 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-0521e428-cbf4-4c71-8729-5b1b7ee8430d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:23.251439 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0521e428-cbf4-4c71-8729-5b1b7ee8430d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:23.251886 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0521e428-cbf4-4c71-8729-5b1b7ee8430d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:23.252670 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0521e428-cbf4-4c71-8729-5b1b7ee8430d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:23.253092 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0521e428-cbf4-4c71-8729-5b1b7ee8430d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:23.254569 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-907756a8-e3e3-49ff-afb8-532ce2ca0525 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61296c57f8643a3a1e8bacf33274c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7fa8cd6f5944d3d9e3ac1d8e6b73924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:23.266512 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-907756a8-e3e3-49ff-afb8-532ce2ca0525 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] 10.222.0.45 "GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef" status: 200 len: 1266 microversion: 2.1 time: 0.107942 May 26 15:23:23.267445 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 538/1103] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:23 2022] GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef => generated 1266 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:23.422242 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.network.security_group_api [None req-0521e428-cbf4-4c71-8729-5b1b7ee8430d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Adding security group 83b6915f-3fbf-426b-a233-5f25cf3571ce to port 1c375646-f237-4900-866d-7a3da3589b33 May 26 15:23:23.879780 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-0521e428-cbf4-4c71-8729-5b1b7ee8430d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "POST /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae/action" status: 202 len: 0 microversion: 2.1 time: 0.641673 May 26 15:23:23.881933 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 566/1104] 10.222.0.45 () {60 vars in 1277 bytes} [Thu May 26 15:23:23 2022] POST /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae/action => generated 0 bytes in 643 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:23:23.893149 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-5c33d472-0faa-486a-b127-9349d4d30a13 req-59104526-056e-45af-a31e-f12cd7016435 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "974b6652-5d82-41a1-be5d-9a3adc0f7cae", "tag": "1c375646-f237-4900-866d-7a3da3589b33"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:23:23.898234 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-c1e754b8-643f-4941-ae7e-e42655823723 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:23.906413 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-c1e754b8-643f-4941-ae7e-e42655823723 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:23.926485 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c1e754b8-643f-4941-ae7e-e42655823723 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:23.927479 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c1e754b8-643f-4941-ae7e-e42655823723 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:23.928627 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c1e754b8-643f-4941-ae7e-e42655823723 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:23.936396 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-5c33d472-0faa-486a-b127-9349d4d30a13 req-59104526-056e-45af-a31e-f12cd7016435 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:23.936965 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-5c33d472-0faa-486a-b127-9349d4d30a13 req-59104526-056e-45af-a31e-f12cd7016435 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:23.940571 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c1e754b8-643f-4941-ae7e-e42655823723 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:23.959381 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-5c33d472-0faa-486a-b127-9349d4d30a13 req-59104526-056e-45af-a31e-f12cd7016435 service nova] Creating event network-changed:1c375646-f237-4900-866d-7a3da3589b33 for instance 974b6652-5d82-41a1-be5d-9a3adc0f7cae on hv-cinder-84301 May 26 15:23:23.969385 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-5c33d472-0faa-486a-b127-9349d4d30a13 req-59104526-056e-45af-a31e-f12cd7016435 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084260 May 26 15:23:23.974204 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 539/1105] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:23:24.238651 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-c1e754b8-643f-4941-ae7e-e42655823723 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:24.248657 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-c1e754b8-643f-4941-ae7e-e42655823723 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1758 microversion: 2.1 time: 0.361724 May 26 15:23:24.249615 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 567/1106] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:23 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1758 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:24.290406 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-8325e7c8-61e8-4079-8461-d19dd24882a5 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:24.292708 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-8325e7c8-61e8-4079-8461-d19dd24882a5 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] [instance: f2bc2950-8f82-443b-9b33-b0e71a2ec3ef] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:24.300869 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8325e7c8-61e8-4079-8461-d19dd24882a5 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:24.301782 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8325e7c8-61e8-4079-8461-d19dd24882a5 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:24.303138 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8325e7c8-61e8-4079-8461-d19dd24882a5 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:24.303853 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8325e7c8-61e8-4079-8461-d19dd24882a5 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:24.392580 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-8325e7c8-61e8-4079-8461-d19dd24882a5 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61296c57f8643a3a1e8bacf33274c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7fa8cd6f5944d3d9e3ac1d8e6b73924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:24.405408 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-8325e7c8-61e8-4079-8461-d19dd24882a5 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] 10.222.0.45 "GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef" status: 200 len: 1272 microversion: 2.1 time: 0.123698 May 26 15:23:24.407017 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 540/1107] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:24 2022] GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef => generated 1272 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:25.423573 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-415d26ea-4dc7-435a-add5-2b70fb421d0c tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:25.424286 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-415d26ea-4dc7-435a-add5-2b70fb421d0c tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] [instance: f2bc2950-8f82-443b-9b33-b0e71a2ec3ef] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:25.431620 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-415d26ea-4dc7-435a-add5-2b70fb421d0c tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:25.433088 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-415d26ea-4dc7-435a-add5-2b70fb421d0c tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:25.434133 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-415d26ea-4dc7-435a-add5-2b70fb421d0c tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:25.434937 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-415d26ea-4dc7-435a-add5-2b70fb421d0c tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:25.558441 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-d30c5802-1bc7-488c-853f-971642a311eb req-54b7b14f-14b2-4468-ab31-9d76aa1e02db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2bc2950-8f82-443b-9b33-b0e71a2ec3ef", "tag": "510139ac-a849-47e9-88ce-5b5415fe89d7"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:23:25.596363 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-415d26ea-4dc7-435a-add5-2b70fb421d0c tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61296c57f8643a3a1e8bacf33274c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7fa8cd6f5944d3d9e3ac1d8e6b73924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:25.604405 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-d30c5802-1bc7-488c-853f-971642a311eb req-54b7b14f-14b2-4468-ab31-9d76aa1e02db service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:25.605103 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-d30c5802-1bc7-488c-853f-971642a311eb req-54b7b14f-14b2-4468-ab31-9d76aa1e02db service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:25.607977 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-415d26ea-4dc7-435a-add5-2b70fb421d0c tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] 10.222.0.45 "GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef" status: 200 len: 1314 microversion: 2.1 time: 0.188145 May 26 15:23:25.608898 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 568/1108] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:25 2022] GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:25.626061 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-d30c5802-1bc7-488c-853f-971642a311eb req-54b7b14f-14b2-4468-ab31-9d76aa1e02db service nova] Creating event network-changed:510139ac-a849-47e9-88ce-5b5415fe89d7 for instance f2bc2950-8f82-443b-9b33-b0e71a2ec3ef on hv-cinder-84301 May 26 15:23:25.631042 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-d30c5802-1bc7-488c-853f-971642a311eb req-54b7b14f-14b2-4468-ab31-9d76aa1e02db service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081645 May 26 15:23:25.631754 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 541/1109] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:23:26.626119 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-33e57ac1-e551-4823-b673-0e5bb825e49b tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:26.626729 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-33e57ac1-e551-4823-b673-0e5bb825e49b tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] [instance: f2bc2950-8f82-443b-9b33-b0e71a2ec3ef] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:26.633197 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-33e57ac1-e551-4823-b673-0e5bb825e49b tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:26.633643 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-33e57ac1-e551-4823-b673-0e5bb825e49b tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:26.634401 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-33e57ac1-e551-4823-b673-0e5bb825e49b tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:26.634835 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-33e57ac1-e551-4823-b673-0e5bb825e49b tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:26.770610 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-33e57ac1-e551-4823-b673-0e5bb825e49b tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61296c57f8643a3a1e8bacf33274c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7fa8cd6f5944d3d9e3ac1d8e6b73924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:26.778338 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-33e57ac1-e551-4823-b673-0e5bb825e49b tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] 10.222.0.45 "GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef" status: 200 len: 1314 microversion: 2.1 time: 0.156098 May 26 15:23:26.778912 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 569/1110] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:26 2022] GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:27.796854 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a4e734e9-93da-4eaa-adae-5159cf9a664e tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:27.797552 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a4e734e9-93da-4eaa-adae-5159cf9a664e tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] [instance: f2bc2950-8f82-443b-9b33-b0e71a2ec3ef] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:27.803698 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a4e734e9-93da-4eaa-adae-5159cf9a664e tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:27.804144 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a4e734e9-93da-4eaa-adae-5159cf9a664e tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:27.804911 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a4e734e9-93da-4eaa-adae-5159cf9a664e tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:27.805350 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a4e734e9-93da-4eaa-adae-5159cf9a664e tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:27.937576 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a4e734e9-93da-4eaa-adae-5159cf9a664e tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61296c57f8643a3a1e8bacf33274c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7fa8cd6f5944d3d9e3ac1d8e6b73924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:27.945306 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a4e734e9-93da-4eaa-adae-5159cf9a664e tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] 10.222.0.45 "GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef" status: 200 len: 1314 microversion: 2.1 time: 0.153857 May 26 15:23:27.945912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 542/1111] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:27 2022] GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:28.962003 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-380a8d84-1f57-4b8f-b263-6af6a998ef58 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:28.962644 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-380a8d84-1f57-4b8f-b263-6af6a998ef58 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] [instance: f2bc2950-8f82-443b-9b33-b0e71a2ec3ef] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:28.965775 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_api:SELECT=38 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:23:28.971328 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-380a8d84-1f57-4b8f-b263-6af6a998ef58 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:28.971779 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-380a8d84-1f57-4b8f-b263-6af6a998ef58 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:28.972541 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-380a8d84-1f57-4b8f-b263-6af6a998ef58 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:28.972975 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-380a8d84-1f57-4b8f-b263-6af6a998ef58 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:28.989513 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:23:29.109413 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-380a8d84-1f57-4b8f-b263-6af6a998ef58 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61296c57f8643a3a1e8bacf33274c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7fa8cd6f5944d3d9e3ac1d8e6b73924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:29.116897 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-380a8d84-1f57-4b8f-b263-6af6a998ef58 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] 10.222.0.45 "GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef" status: 200 len: 1314 microversion: 2.1 time: 0.158746 May 26 15:23:29.117461 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 570/1112] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:28 2022] GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:30.134249 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f94fb397-d05e-4645-b784-f1aa196ab6c2 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:30.134790 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f94fb397-d05e-4645-b784-f1aa196ab6c2 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] [instance: f2bc2950-8f82-443b-9b33-b0e71a2ec3ef] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:30.142237 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f94fb397-d05e-4645-b784-f1aa196ab6c2 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:30.142687 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f94fb397-d05e-4645-b784-f1aa196ab6c2 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:30.143484 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f94fb397-d05e-4645-b784-f1aa196ab6c2 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:30.143923 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f94fb397-d05e-4645-b784-f1aa196ab6c2 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:30.277397 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f94fb397-d05e-4645-b784-f1aa196ab6c2 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61296c57f8643a3a1e8bacf33274c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7fa8cd6f5944d3d9e3ac1d8e6b73924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:30.283131 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f94fb397-d05e-4645-b784-f1aa196ab6c2 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] 10.222.0.45 "GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef" status: 200 len: 1314 microversion: 2.1 time: 0.153139 May 26 15:23:30.283713 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 543/1113] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:30 2022] GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:31.300832 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-9d30e286-0783-487f-bb2b-9c47949cf89f tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:31.301511 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-9d30e286-0783-487f-bb2b-9c47949cf89f tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] [instance: f2bc2950-8f82-443b-9b33-b0e71a2ec3ef] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:31.308954 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9d30e286-0783-487f-bb2b-9c47949cf89f tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:31.309407 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9d30e286-0783-487f-bb2b-9c47949cf89f tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:31.310672 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9d30e286-0783-487f-bb2b-9c47949cf89f tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:31.311156 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9d30e286-0783-487f-bb2b-9c47949cf89f tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:31.438048 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-9d30e286-0783-487f-bb2b-9c47949cf89f tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61296c57f8643a3a1e8bacf33274c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7fa8cd6f5944d3d9e3ac1d8e6b73924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:31.445486 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-9d30e286-0783-487f-bb2b-9c47949cf89f tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] 10.222.0.45 "GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef" status: 200 len: 1314 microversion: 2.1 time: 0.148626 May 26 15:23:31.446046 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 571/1114] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:31 2022] GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:32.464043 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-512eea2c-0a53-4401-b02e-e8a7598683f0 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:32.464603 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-512eea2c-0a53-4401-b02e-e8a7598683f0 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] [instance: f2bc2950-8f82-443b-9b33-b0e71a2ec3ef] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:32.466699 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=2 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:23:32.467559 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=6 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:23:32.473640 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-512eea2c-0a53-4401-b02e-e8a7598683f0 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:32.474089 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-512eea2c-0a53-4401-b02e-e8a7598683f0 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:32.474860 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-512eea2c-0a53-4401-b02e-e8a7598683f0 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:32.475317 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-512eea2c-0a53-4401-b02e-e8a7598683f0 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:32.610607 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-512eea2c-0a53-4401-b02e-e8a7598683f0 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61296c57f8643a3a1e8bacf33274c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7fa8cd6f5944d3d9e3ac1d8e6b73924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:32.618055 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-512eea2c-0a53-4401-b02e-e8a7598683f0 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] 10.222.0.45 "GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef" status: 200 len: 1314 microversion: 2.1 time: 0.158186 May 26 15:23:32.618616 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 544/1115] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:32 2022] GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:33.635764 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-4d7aa361-c1b5-4d79-8aed-9bf4c4008a32 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:33.636481 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-4d7aa361-c1b5-4d79-8aed-9bf4c4008a32 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] [instance: f2bc2950-8f82-443b-9b33-b0e71a2ec3ef] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:33.638830 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell0:SELECT=2 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:23:33.644585 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4d7aa361-c1b5-4d79-8aed-9bf4c4008a32 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:33.650255 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4d7aa361-c1b5-4d79-8aed-9bf4c4008a32 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:33.651121 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4d7aa361-c1b5-4d79-8aed-9bf4c4008a32 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:33.651601 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-4d7aa361-c1b5-4d79-8aed-9bf4c4008a32 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:33.782681 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-4d7aa361-c1b5-4d79-8aed-9bf4c4008a32 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61296c57f8643a3a1e8bacf33274c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7fa8cd6f5944d3d9e3ac1d8e6b73924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:33.790158 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-4d7aa361-c1b5-4d79-8aed-9bf4c4008a32 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] 10.222.0.45 "GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef" status: 200 len: 1314 microversion: 2.1 time: 0.158462 May 26 15:23:33.790725 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 572/1116] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:33 2022] GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:34.807965 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-738d6e2f-3b06-4ead-aa99-04e5e24ef47a tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:34.808662 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-738d6e2f-3b06-4ead-aa99-04e5e24ef47a tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] [instance: f2bc2950-8f82-443b-9b33-b0e71a2ec3ef] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:34.815211 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-738d6e2f-3b06-4ead-aa99-04e5e24ef47a tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:34.815652 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-738d6e2f-3b06-4ead-aa99-04e5e24ef47a tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:34.816405 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-738d6e2f-3b06-4ead-aa99-04e5e24ef47a tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:34.816829 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-738d6e2f-3b06-4ead-aa99-04e5e24ef47a tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:34.954323 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-738d6e2f-3b06-4ead-aa99-04e5e24ef47a tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61296c57f8643a3a1e8bacf33274c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7fa8cd6f5944d3d9e3ac1d8e6b73924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:34.961895 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-738d6e2f-3b06-4ead-aa99-04e5e24ef47a tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] 10.222.0.45 "GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef" status: 200 len: 1314 microversion: 2.1 time: 0.158057 May 26 15:23:34.962464 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 545/1117] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:34 2022] GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:35.980296 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-42994a63-d749-419d-a70b-d543e9defb7f tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:35.980881 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-42994a63-d749-419d-a70b-d543e9defb7f tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] [instance: f2bc2950-8f82-443b-9b33-b0e71a2ec3ef] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:35.987356 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-42994a63-d749-419d-a70b-d543e9defb7f tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:35.987801 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-42994a63-d749-419d-a70b-d543e9defb7f tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:35.988554 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-42994a63-d749-419d-a70b-d543e9defb7f tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:35.988993 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-42994a63-d749-419d-a70b-d543e9defb7f tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:36.124901 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-42994a63-d749-419d-a70b-d543e9defb7f tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61296c57f8643a3a1e8bacf33274c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7fa8cd6f5944d3d9e3ac1d8e6b73924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:36.132375 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-42994a63-d749-419d-a70b-d543e9defb7f tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] 10.222.0.45 "GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef" status: 200 len: 1314 microversion: 2.1 time: 0.156601 May 26 15:23:36.132940 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 573/1118] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:35 2022] GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:36.465413 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:23:36.466044 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Thu May 26 15:23:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 15:23:37.149508 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-21ddb947-bafd-43b5-8aba-88377e285395 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:37.150136 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-21ddb947-bafd-43b5-8aba-88377e285395 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] [instance: f2bc2950-8f82-443b-9b33-b0e71a2ec3ef] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:37.157155 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-21ddb947-bafd-43b5-8aba-88377e285395 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:37.157594 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-21ddb947-bafd-43b5-8aba-88377e285395 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:37.158356 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-21ddb947-bafd-43b5-8aba-88377e285395 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:37.159273 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-21ddb947-bafd-43b5-8aba-88377e285395 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:37.313076 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-21ddb947-bafd-43b5-8aba-88377e285395 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61296c57f8643a3a1e8bacf33274c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7fa8cd6f5944d3d9e3ac1d8e6b73924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:37.321751 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-21ddb947-bafd-43b5-8aba-88377e285395 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] 10.222.0.45 "GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef" status: 200 len: 1314 microversion: 2.1 time: 0.175979 May 26 15:23:37.322859 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 546/1119] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:37 2022] GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:38.340014 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-38ec89c7-fcc8-403f-a3f5-5d8f814219b4 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:38.340739 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-38ec89c7-fcc8-403f-a3f5-5d8f814219b4 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] [instance: f2bc2950-8f82-443b-9b33-b0e71a2ec3ef] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:38.347400 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-38ec89c7-fcc8-403f-a3f5-5d8f814219b4 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:38.348105 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-38ec89c7-fcc8-403f-a3f5-5d8f814219b4 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:38.348869 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-38ec89c7-fcc8-403f-a3f5-5d8f814219b4 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:38.349296 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-38ec89c7-fcc8-403f-a3f5-5d8f814219b4 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:38.480583 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-38ec89c7-fcc8-403f-a3f5-5d8f814219b4 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61296c57f8643a3a1e8bacf33274c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7fa8cd6f5944d3d9e3ac1d8e6b73924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:38.488314 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-38ec89c7-fcc8-403f-a3f5-5d8f814219b4 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] 10.222.0.45 "GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef" status: 200 len: 1314 microversion: 2.1 time: 0.153082 May 26 15:23:38.488879 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 574/1120] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:38 2022] GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:38.852034 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-2d5e00f1-96ef-46c8-a22b-e965b53d0233 req-d97efb77-c984-4d62-b4bc-66e97654a276 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2bc2950-8f82-443b-9b33-b0e71a2ec3ef", "name": "network-vif-plugged", "status": "completed", "tag": "510139ac-a849-47e9-88ce-5b5415fe89d7"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:23:38.861417 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-2d5e00f1-96ef-46c8-a22b-e965b53d0233 req-d97efb77-c984-4d62-b4bc-66e97654a276 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:38.861854 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-2d5e00f1-96ef-46c8-a22b-e965b53d0233 req-d97efb77-c984-4d62-b4bc-66e97654a276 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:38.873837 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-2d5e00f1-96ef-46c8-a22b-e965b53d0233 req-d97efb77-c984-4d62-b4bc-66e97654a276 service nova] Creating event network-vif-plugged:510139ac-a849-47e9-88ce-5b5415fe89d7 for instance f2bc2950-8f82-443b-9b33-b0e71a2ec3ef on hv-cinder-84301 May 26 15:23:38.878778 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-2d5e00f1-96ef-46c8-a22b-e965b53d0233 req-d97efb77-c984-4d62-b4bc-66e97654a276 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030439 May 26 15:23:38.879417 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 547/1121] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:23:39.505729 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-240585de-b7d0-416d-8946-dc273dbf4b31 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:39.506333 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-240585de-b7d0-416d-8946-dc273dbf4b31 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] [instance: f2bc2950-8f82-443b-9b33-b0e71a2ec3ef] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:39.513807 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-240585de-b7d0-416d-8946-dc273dbf4b31 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:39.514516 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-240585de-b7d0-416d-8946-dc273dbf4b31 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:39.515310 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-240585de-b7d0-416d-8946-dc273dbf4b31 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:39.515748 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-240585de-b7d0-416d-8946-dc273dbf4b31 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:39.645575 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-240585de-b7d0-416d-8946-dc273dbf4b31 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61296c57f8643a3a1e8bacf33274c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7fa8cd6f5944d3d9e3ac1d8e6b73924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:39.654080 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-240585de-b7d0-416d-8946-dc273dbf4b31 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] 10.222.0.45 "GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef" status: 200 len: 1314 microversion: 2.1 time: 0.152228 May 26 15:23:39.654647 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 575/1122] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:39 2022] GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:40.672596 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-69fc24f1-21fa-41a2-8b4a-a98d0ace4ab8 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:40.673222 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-69fc24f1-21fa-41a2-8b4a-a98d0ace4ab8 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] [instance: f2bc2950-8f82-443b-9b33-b0e71a2ec3ef] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:40.679510 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-69fc24f1-21fa-41a2-8b4a-a98d0ace4ab8 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:40.679962 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-69fc24f1-21fa-41a2-8b4a-a98d0ace4ab8 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:40.680728 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-69fc24f1-21fa-41a2-8b4a-a98d0ace4ab8 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:40.681166 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-69fc24f1-21fa-41a2-8b4a-a98d0ace4ab8 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:40.812269 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-69fc24f1-21fa-41a2-8b4a-a98d0ace4ab8 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61296c57f8643a3a1e8bacf33274c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7fa8cd6f5944d3d9e3ac1d8e6b73924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:40.819721 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-69fc24f1-21fa-41a2-8b4a-a98d0ace4ab8 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] 10.222.0.45 "GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef" status: 200 len: 1314 microversion: 2.1 time: 0.151962 May 26 15:23:40.820293 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 548/1123] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:40 2022] GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:41.837208 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-df63c97d-61bc-4b4d-9b9d-ed3255ba6012 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:41.837827 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-df63c97d-61bc-4b4d-9b9d-ed3255ba6012 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] [instance: f2bc2950-8f82-443b-9b33-b0e71a2ec3ef] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:41.844456 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-df63c97d-61bc-4b4d-9b9d-ed3255ba6012 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:41.844906 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-df63c97d-61bc-4b4d-9b9d-ed3255ba6012 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:41.845673 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-df63c97d-61bc-4b4d-9b9d-ed3255ba6012 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:41.846112 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-df63c97d-61bc-4b4d-9b9d-ed3255ba6012 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:42.089708 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-df63c97d-61bc-4b4d-9b9d-ed3255ba6012 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61296c57f8643a3a1e8bacf33274c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7fa8cd6f5944d3d9e3ac1d8e6b73924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:42.097582 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-df63c97d-61bc-4b4d-9b9d-ed3255ba6012 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] 10.222.0.45 "GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef" status: 200 len: 1464 microversion: 2.1 time: 0.264138 May 26 15:23:42.098065 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 576/1124] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:41 2022] GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef => generated 1464 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:42.136400 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1befcef2-29b6-407b-b1d8-9484b6f4f33f tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:42.136887 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1befcef2-29b6-407b-b1d8-9484b6f4f33f tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] [instance: f2bc2950-8f82-443b-9b33-b0e71a2ec3ef] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:42.143616 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1befcef2-29b6-407b-b1d8-9484b6f4f33f tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:42.144061 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1befcef2-29b6-407b-b1d8-9484b6f4f33f tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:42.144828 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1befcef2-29b6-407b-b1d8-9484b6f4f33f tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:42.145263 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1befcef2-29b6-407b-b1d8-9484b6f4f33f tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:42.171502 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1befcef2-29b6-407b-b1d8-9484b6f4f33f tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] [instance: f2bc2950-8f82-443b-9b33-b0e71a2ec3ef] Going to try to terminate instance {{(pid=117798) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:23:42.243908 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1befcef2-29b6-407b-b1d8-9484b6f4f33f tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef" status: 204 len: 0 microversion: 2.1 time: 0.111105 May 26 15:23:42.244498 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 549/1125] 10.222.0.45 () {58 vars in 1238 bytes} [Thu May 26 15:23:42 2022] DELETE /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:23:42.254395 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-7620406e-21c7-4e9c-9004-85bb365cb951 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:42.255004 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-7620406e-21c7-4e9c-9004-85bb365cb951 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] [instance: f2bc2950-8f82-443b-9b33-b0e71a2ec3ef] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:42.260942 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7620406e-21c7-4e9c-9004-85bb365cb951 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:42.261382 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7620406e-21c7-4e9c-9004-85bb365cb951 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:42.262135 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7620406e-21c7-4e9c-9004-85bb365cb951 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:42.262568 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7620406e-21c7-4e9c-9004-85bb365cb951 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:42.392039 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-7620406e-21c7-4e9c-9004-85bb365cb951 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61296c57f8643a3a1e8bacf33274c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7fa8cd6f5944d3d9e3ac1d8e6b73924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:42.399533 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-7620406e-21c7-4e9c-9004-85bb365cb951 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] 10.222.0.45 "GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef" status: 200 len: 1470 microversion: 2.1 time: 0.149286 May 26 15:23:42.400105 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 577/1126] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:42 2022] GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef => generated 1470 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:23:43.417430 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c911cb89-94ca-4e3a-9571-e6d893570d48 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:43.418044 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c911cb89-94ca-4e3a-9571-e6d893570d48 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] [instance: f2bc2950-8f82-443b-9b33-b0e71a2ec3ef] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:43.424636 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c911cb89-94ca-4e3a-9571-e6d893570d48 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:43.425082 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c911cb89-94ca-4e3a-9571-e6d893570d48 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:43.425843 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c911cb89-94ca-4e3a-9571-e6d893570d48 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:43.426272 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c911cb89-94ca-4e3a-9571-e6d893570d48 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:43.601591 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-e067eb05-ed7a-4cce-ac84-afbc563f799a tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f8755df-5404-4550-863d-5c9c9330a757", "device": "/dev/sdb"}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:23:43.603256 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-e067eb05-ed7a-4cce-ac84-afbc563f799a tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:43.609777 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e067eb05-ed7a-4cce-ac84-afbc563f799a tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:43.610266 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e067eb05-ed7a-4cce-ac84-afbc563f799a tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:43.611035 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e067eb05-ed7a-4cce-ac84-afbc563f799a tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:43.611257 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c911cb89-94ca-4e3a-9571-e6d893570d48 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61296c57f8643a3a1e8bacf33274c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7fa8cd6f5944d3d9e3ac1d8e6b73924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:43.611506 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e067eb05-ed7a-4cce-ac84-afbc563f799a tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:43.619065 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c911cb89-94ca-4e3a-9571-e6d893570d48 tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] 10.222.0.45 "GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef" status: 200 len: 1470 microversion: 2.1 time: 0.206460 May 26 15:23:43.620164 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 550/1127] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:43 2022] GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef => generated 1470 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:43.860821 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-e067eb05-ed7a-4cce-ac84-afbc563f799a tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "POST /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263037 May 26 15:23:43.864090 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 578/1128] 10.222.0.45 () {60 vars in 1322 bytes} [Thu May 26 15:23:43 2022] POST /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:23:44.637383 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-8de96ec7-1a1f-465f-a626-276dc645258a tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:44.637987 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-8de96ec7-1a1f-465f-a626-276dc645258a tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] [instance: f2bc2950-8f82-443b-9b33-b0e71a2ec3ef] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:44.644724 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8de96ec7-1a1f-465f-a626-276dc645258a tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:44.645197 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8de96ec7-1a1f-465f-a626-276dc645258a tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:44.645963 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8de96ec7-1a1f-465f-a626-276dc645258a tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:44.646394 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-8de96ec7-1a1f-465f-a626-276dc645258a tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:44.779982 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-8de96ec7-1a1f-465f-a626-276dc645258a tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61296c57f8643a3a1e8bacf33274c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7fa8cd6f5944d3d9e3ac1d8e6b73924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:44.791146 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-8de96ec7-1a1f-465f-a626-276dc645258a tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] 10.222.0.45 "GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef" status: 200 len: 1470 microversion: 2.1 time: 0.158084 May 26 15:23:44.791698 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 551/1129] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:44 2022] GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:44.939318 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-b363cc42-14c2-4908-9304-1365b31667a5 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-819374744", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1181214903", "security_groups": [{"name": "tempest-secgroup-smoke-986633093"}], "block_device_mapping_v2": [{"uuid": "0f3fe480-e5c2-45a8-bda5-2e1f94a91756", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "38936b65-04c9-4d68-a6df-607fd923b2aa"}]}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:23:45.065187 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.network.neutron [None req-b363cc42-14c2-4908-9304-1365b31667a5 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] validate_networks() for [('38936b65-04c9-4d68-a6df-607fd923b2aa', None, None, None, None, None)] {{(pid=117799) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:23:45.248272 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-e958e767-f546-46b5-8090-95ffdde30abc req-176daa6c-d8b0-46dd-a812-4630d3f32163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2bc2950-8f82-443b-9b33-b0e71a2ec3ef", "name": "network-vif-deleted", "tag": "510139ac-a849-47e9-88ce-5b5415fe89d7"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:23:45.278076 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-e958e767-f546-46b5-8090-95ffdde30abc req-176daa6c-d8b0-46dd-a812-4630d3f32163 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:45.280018 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-e958e767-f546-46b5-8090-95ffdde30abc req-176daa6c-d8b0-46dd-a812-4630d3f32163 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:45.297962 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-e958e767-f546-46b5-8090-95ffdde30abc req-176daa6c-d8b0-46dd-a812-4630d3f32163 service nova] Creating event network-vif-deleted:510139ac-a849-47e9-88ce-5b5415fe89d7 for instance f2bc2950-8f82-443b-9b33-b0e71a2ec3ef on hv-cinder-84301 May 26 15:23:45.303145 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-e958e767-f546-46b5-8090-95ffdde30abc req-176daa6c-d8b0-46dd-a812-4630d3f32163 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058753 May 26 15:23:45.304321 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 552/1130] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:23:45.496495 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-b363cc42-14c2-4908-9304-1365b31667a5 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Flavor limits 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:23:45.496920 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-b363cc42-14c2-4908-9304-1365b31667a5 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Image limits 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:23:45.497397 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-b363cc42-14c2-4908-9304-1365b31667a5 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Flavor pref 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:23:45.497830 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-b363cc42-14c2-4908-9304-1365b31667a5 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Image pref 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:23:45.498261 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-b363cc42-14c2-4908-9304-1365b31667a5 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:23:45.506949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b363cc42-14c2-4908-9304-1365b31667a5 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:45.507427 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b363cc42-14c2-4908-9304-1365b31667a5 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:45.508225 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b363cc42-14c2-4908-9304-1365b31667a5 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:45.508657 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b363cc42-14c2-4908-9304-1365b31667a5 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:45.525304 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.quota [None req-b363cc42-14c2-4908-9304-1365b31667a5 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Getting quotas for project 1da6b127a0d64f8892c4935ef08ed679. Resources: {'cores', 'ram', 'instances'} {{(pid=117799) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:23:45.529499 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.quota [None req-b363cc42-14c2-4908-9304-1365b31667a5 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Getting quotas for user e55884035fd3441583ece37dd8eb9248 and project 1da6b127a0d64f8892c4935ef08ed679. Resources: {'cores', 'ram', 'instances'} {{(pid=117799) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:23:45.586720 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-b363cc42-14c2-4908-9304-1365b31667a5 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Going to run 1 instances... {{(pid=117799) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:23:45.589062 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-b363cc42-14c2-4908-9304-1365b31667a5 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 5d1d8945-5896-4ef2-9033-3b091083a15b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0f3fe480-e5c2-45a8-bda5-2e1f94a91756',volume_size=None,volume_type=None)] {{(pid=117799) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:23:45.732526 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-b363cc42-14c2-4908-9304-1365b31667a5 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.798199 May 26 15:23:45.733489 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 579/1131] 10.222.0.45 () {60 vars in 1146 bytes} [Thu May 26 15:23:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 15:23:45.748015 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-9d9dd4de-448b-4937-aaac-45bdcd32374b tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:45.749144 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-9d9dd4de-448b-4937-aaac-45bdcd32374b tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 5d1d8945-5896-4ef2-9033-3b091083a15b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:45.816123 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-788b2f91-4f27-4ace-9a58-13f1ef4d8c6d tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:45.816960 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-788b2f91-4f27-4ace-9a58-13f1ef4d8c6d tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] [instance: f2bc2950-8f82-443b-9b33-b0e71a2ec3ef] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:45.824698 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-9d9dd4de-448b-4937-aaac-45bdcd32374b tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:45.828070 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-788b2f91-4f27-4ace-9a58-13f1ef4d8c6d tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:45.828603 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-788b2f91-4f27-4ace-9a58-13f1ef4d8c6d tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:45.829456 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-788b2f91-4f27-4ace-9a58-13f1ef4d8c6d tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:45.829899 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-788b2f91-4f27-4ace-9a58-13f1ef4d8c6d tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:45.833109 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-9d9dd4de-448b-4937-aaac-45bdcd32374b tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b" status: 200 len: 1094 microversion: 2.1 time: 0.090626 May 26 15:23:45.833682 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 553/1132] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:45 2022] GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b => generated 1094 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:45.848191 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.wsgi [None req-788b2f91-4f27-4ace-9a58-13f1ef4d8c6d tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] HTTP exception thrown: Instance f2bc2950-8f82-443b-9b33-b0e71a2ec3ef could not be found. May 26 15:23:45.850041 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-788b2f91-4f27-4ace-9a58-13f1ef4d8c6d tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Request method failure captured: May 26 15:23:45.850041 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: request: GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef HTTP/1.1 May 26 15:23:45.850041 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept: application/json May 26 15:23:45.850041 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept-Encoding: identity May 26 15:23:45.850041 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Connection: close May 26 15:23:45.850041 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Length: 0 May 26 15:23:45.850041 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Type: application/json May 26 15:23:45.850041 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Host: 10.222.0.45 May 26 15:23:45.850041 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Openstack-System-Scope: None May 26 15:23:45.850041 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: User-Agent: python-urllib3/1.26.9 May 26 15:23:45.850041 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Auth-Token: gAAAAABij5tn30RTYxf1P_sYiFjGCo6FJJav7bVWSPM-QRWhhM4ClOxuU0gMz-rX0klqRcpoArD0SUSeC_qoMc2juAwFt8n5mT902mfseHS9R1kKuxlT40Po2SJQ7SybM_65Y4vIIW3hUDJMjiVEDhw-J27z_eOoPVprnxC9URrsP6pmJP-xjA8 May 26 15:23:45.850041 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Id: None May 26 15:23:45.850041 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Name: None May 26 15:23:45.850041 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Identity-Status: Confirmed May 26 15:23:45.850041 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Is-Admin-Project: True May 26 15:23:45.850041 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Id: default May 26 15:23:45.850041 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Name: Default May 26 15:23:45.850041 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Id: b7fa8cd6f5944d3d9e3ac1d8e6b73924 May 26 15:23:45.850041 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Name: tempest-VolumesNegativeTest-1865479384 May 26 15:23:45.850041 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Role: reader,member May 26 15:23:45.850041 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Roles: reader,member May 26 15:23:45.851761 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b7fa8cd6f5944d3d9e3ac1d8e6b73924"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b7fa8cd6f5944d3d9e3ac1d8e6b73924"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b7fa8cd6f5944d3d9e3ac1d8e6b73924"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b7fa8cd6f5944d3d9e3ac1d8e6b73924"}]}] May 26 15:23:45.851761 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant: tempest-VolumesNegativeTest-1865479384 May 26 15:23:45.851761 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Id: b7fa8cd6f5944d3d9e3ac1d8e6b73924 May 26 15:23:45.851761 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Name: tempest-VolumesNegativeTest-1865479384 May 26 15:23:45.851761 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User: tempest-VolumesNegativeTest-1865479384-project May 26 15:23:45.851761 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Id: default May 26 15:23:45.851761 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Name: Default May 26 15:23:45.851761 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Id: f61296c57f8643a3a1e8bacf33274c69 May 26 15:23:45.851761 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Name: tempest-VolumesNegativeTest-1865479384-project May 26 15:23:45.851761 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: method: > May 26 15:23:45.851761 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: exception: Instance f2bc2950-8f82-443b-9b33-b0e71a2ec3ef could not be found. May 26 15:23:45.851761 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: action_args: {'id': 'f2bc2950-8f82-443b-9b33-b0e71a2ec3ef'} May 26 15:23:45.852737 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:23:45.852737 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:23:45.852737 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:23:45.852737 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:23:45.852737 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:23:45.852737 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:23:45.852737 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:23:45.852737 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:23:45.852737 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:23:45.852737 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:23:45.852737 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2bc2950-8f82-443b-9b33-b0e71a2ec3ef could not be found. May 26 15:23:45.852737 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:23:45.852737 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:23:45.852737 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:23:45.852737 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:23:45.852737 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:23:45.852737 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:23:45.852737 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:23:45.852737 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:23:45.852737 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:23:45.856519 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:23:45.856519 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:23:45.856519 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:23:45.856519 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:23:45.856519 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:23:45.856519 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:23:45.856519 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:23:45.856519 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2bc2950-8f82-443b-9b33-b0e71a2ec3ef could not be found. May 26 15:23:45.856519 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:23:45.856519 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:23:45.856519 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:23:45.856519 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:23:45.856519 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:23:45.856519 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:23:45.856519 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:23:45.856519 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:23:45.856519 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2bc2950-8f82-443b-9b33-b0e71a2ec3ef could not be found. May 26 15:23:45.856519 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:23:45.857937 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-788b2f91-4f27-4ace-9a58-13f1ef4d8c6d tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] Returning 404 to user: Instance f2bc2950-8f82-443b-9b33-b0e71a2ec3ef could not be found. {{(pid=117799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:23:45.857937 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-788b2f91-4f27-4ace-9a58-13f1ef4d8c6d tempest-VolumesNegativeTest-1865479384 tempest-VolumesNegativeTest-1865479384-project] 10.222.0.45 "GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef" status: 404 len: 111 microversion: 2.1 time: 0.041013 May 26 15:23:45.857937 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 580/1133] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:45 2022] GET /compute/v2.1/servers/f2bc2950-8f82-443b-9b33-b0e71a2ec3ef => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:23:46.851216 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b29c3662-83da-42df-89a2-5715c845a7cd tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:46.851827 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b29c3662-83da-42df-89a2-5715c845a7cd tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 5d1d8945-5896-4ef2-9033-3b091083a15b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:46.859733 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b29c3662-83da-42df-89a2-5715c845a7cd tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:46.860180 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b29c3662-83da-42df-89a2-5715c845a7cd tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:46.860948 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b29c3662-83da-42df-89a2-5715c845a7cd tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:46.861457 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b29c3662-83da-42df-89a2-5715c845a7cd tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:46.927534 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-b29c3662-83da-42df-89a2-5715c845a7cd tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:46.944839 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b29c3662-83da-42df-89a2-5715c845a7cd tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b" status: 200 len: 1200 microversion: 2.1 time: 0.097183 May 26 15:23:46.955000 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 554/1134] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:46 2022] GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b => generated 1200 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:47.963702 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-bb883a75-7de6-40a7-ac92-23e7a844b1ed tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:47.965798 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-bb883a75-7de6-40a7-ac92-23e7a844b1ed tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 5d1d8945-5896-4ef2-9033-3b091083a15b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:47.975296 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-bb883a75-7de6-40a7-ac92-23e7a844b1ed tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:47.975884 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-bb883a75-7de6-40a7-ac92-23e7a844b1ed tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:47.976657 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-bb883a75-7de6-40a7-ac92-23e7a844b1ed tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:47.977129 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-bb883a75-7de6-40a7-ac92-23e7a844b1ed tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:48.157432 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-bb883a75-7de6-40a7-ac92-23e7a844b1ed tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:48.173599 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-bb883a75-7de6-40a7-ac92-23e7a844b1ed tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b" status: 200 len: 1277 microversion: 2.1 time: 0.214530 May 26 15:23:48.191540 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 581/1135] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:47 2022] GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b => generated 1277 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:48.818770 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-7e375882-2670-480e-8a1c-92dfbeba51db req-e0c333f9-81d0-446f-8237-1e7e6da8464a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d1d8945-5896-4ef2-9033-3b091083a15b", "tag": "2edf9591-6b8d-40a5-bf70-1046a458a5d4"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:23:48.828668 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-7e375882-2670-480e-8a1c-92dfbeba51db req-e0c333f9-81d0-446f-8237-1e7e6da8464a service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:48.829430 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-7e375882-2670-480e-8a1c-92dfbeba51db req-e0c333f9-81d0-446f-8237-1e7e6da8464a service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:48.843930 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-7e375882-2670-480e-8a1c-92dfbeba51db req-e0c333f9-81d0-446f-8237-1e7e6da8464a service nova] Creating event network-changed:2edf9591-6b8d-40a5-bf70-1046a458a5d4 for instance 5d1d8945-5896-4ef2-9033-3b091083a15b on hv-cinder-84301 May 26 15:23:48.851222 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-7e375882-2670-480e-8a1c-92dfbeba51db req-e0c333f9-81d0-446f-8237-1e7e6da8464a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034703 May 26 15:23:48.852408 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 555/1136] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:23:49.202586 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-908a9ce8-ac79-4dc1-afd7-95dabddf7ed4 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:49.203967 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-908a9ce8-ac79-4dc1-afd7-95dabddf7ed4 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 5d1d8945-5896-4ef2-9033-3b091083a15b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:49.212587 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-908a9ce8-ac79-4dc1-afd7-95dabddf7ed4 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:49.213596 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-908a9ce8-ac79-4dc1-afd7-95dabddf7ed4 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:49.214257 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-908a9ce8-ac79-4dc1-afd7-95dabddf7ed4 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:49.214914 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-908a9ce8-ac79-4dc1-afd7-95dabddf7ed4 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:49.361036 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-908a9ce8-ac79-4dc1-afd7-95dabddf7ed4 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:49.368580 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-908a9ce8-ac79-4dc1-afd7-95dabddf7ed4 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b" status: 200 len: 1277 microversion: 2.1 time: 0.171427 May 26 15:23:49.369293 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 582/1137] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:49 2022] GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b => generated 1277 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:50.387448 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-fa8302df-63ae-490d-893f-4987550d617f tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:50.388147 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-fa8302df-63ae-490d-893f-4987550d617f tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 5d1d8945-5896-4ef2-9033-3b091083a15b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:50.394586 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fa8302df-63ae-490d-893f-4987550d617f tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:50.395024 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fa8302df-63ae-490d-893f-4987550d617f tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:50.395846 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fa8302df-63ae-490d-893f-4987550d617f tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:50.396289 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-fa8302df-63ae-490d-893f-4987550d617f tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:50.414046 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:23:50.533068 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-fa8302df-63ae-490d-893f-4987550d617f tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:50.540766 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-fa8302df-63ae-490d-893f-4987550d617f tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b" status: 200 len: 1277 microversion: 2.1 time: 0.158837 May 26 15:23:50.541907 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 556/1138] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:50 2022] GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:51.558752 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-a3a5af08-e26a-4abc-9269-309d4384eab9 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:51.559446 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-a3a5af08-e26a-4abc-9269-309d4384eab9 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 5d1d8945-5896-4ef2-9033-3b091083a15b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:51.566097 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a3a5af08-e26a-4abc-9269-309d4384eab9 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:51.566543 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a3a5af08-e26a-4abc-9269-309d4384eab9 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:51.567359 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a3a5af08-e26a-4abc-9269-309d4384eab9 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:51.567816 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a3a5af08-e26a-4abc-9269-309d4384eab9 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:51.702018 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-a3a5af08-e26a-4abc-9269-309d4384eab9 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:51.710671 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-a3a5af08-e26a-4abc-9269-309d4384eab9 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b" status: 200 len: 1277 microversion: 2.1 time: 0.156528 May 26 15:23:51.711277 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 583/1139] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:51 2022] GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b => generated 1277 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:52.727709 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-11035499-b907-4e6a-9a11-e0eda2454f42 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:52.728310 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-11035499-b907-4e6a-9a11-e0eda2454f42 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 5d1d8945-5896-4ef2-9033-3b091083a15b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:52.731190 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:23:52.736965 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-11035499-b907-4e6a-9a11-e0eda2454f42 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:52.737446 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-11035499-b907-4e6a-9a11-e0eda2454f42 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:52.738271 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-11035499-b907-4e6a-9a11-e0eda2454f42 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:52.738695 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-11035499-b907-4e6a-9a11-e0eda2454f42 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:52.876239 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-11035499-b907-4e6a-9a11-e0eda2454f42 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:52.883923 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-11035499-b907-4e6a-9a11-e0eda2454f42 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b" status: 200 len: 1265 microversion: 2.1 time: 0.159972 May 26 15:23:52.884434 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 557/1140] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:52 2022] GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:53.901719 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-dcd8a1a4-2ccb-4f56-8a57-22ec8d461faf tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:53.902332 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-dcd8a1a4-2ccb-4f56-8a57-22ec8d461faf tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 5d1d8945-5896-4ef2-9033-3b091083a15b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:53.909032 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dcd8a1a4-2ccb-4f56-8a57-22ec8d461faf tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:53.909419 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dcd8a1a4-2ccb-4f56-8a57-22ec8d461faf tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:53.910239 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dcd8a1a4-2ccb-4f56-8a57-22ec8d461faf tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:53.910675 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dcd8a1a4-2ccb-4f56-8a57-22ec8d461faf tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:54.039471 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-dcd8a1a4-2ccb-4f56-8a57-22ec8d461faf tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:54.047370 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-dcd8a1a4-2ccb-4f56-8a57-22ec8d461faf tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b" status: 200 len: 1265 microversion: 2.1 time: 0.150178 May 26 15:23:54.047948 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 584/1141] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:53 2022] GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:55.063848 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ea01fe06-9469-4ecf-b0d1-916c9d7cc07c tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:55.064457 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ea01fe06-9469-4ecf-b0d1-916c9d7cc07c tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 5d1d8945-5896-4ef2-9033-3b091083a15b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:55.070989 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ea01fe06-9469-4ecf-b0d1-916c9d7cc07c tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:55.071476 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ea01fe06-9469-4ecf-b0d1-916c9d7cc07c tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:55.072268 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ea01fe06-9469-4ecf-b0d1-916c9d7cc07c tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:55.072709 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ea01fe06-9469-4ecf-b0d1-916c9d7cc07c tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:55.203778 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ea01fe06-9469-4ecf-b0d1-916c9d7cc07c tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:55.211299 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ea01fe06-9469-4ecf-b0d1-916c9d7cc07c tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b" status: 200 len: 1265 microversion: 2.1 time: 0.151309 May 26 15:23:55.211869 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 558/1142] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:55 2022] GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:56.229110 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-e07505a9-3221-4f81-b5d9-0bed032cc9e7 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:56.229718 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-e07505a9-3221-4f81-b5d9-0bed032cc9e7 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 5d1d8945-5896-4ef2-9033-3b091083a15b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:56.232322 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell0:SELECT=2 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:23:56.233014 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell0:SELECT=6 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:23:56.239357 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e07505a9-3221-4f81-b5d9-0bed032cc9e7 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:56.239808 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e07505a9-3221-4f81-b5d9-0bed032cc9e7 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:56.240579 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e07505a9-3221-4f81-b5d9-0bed032cc9e7 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:56.241022 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e07505a9-3221-4f81-b5d9-0bed032cc9e7 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:56.373041 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-e07505a9-3221-4f81-b5d9-0bed032cc9e7 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:56.380413 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-e07505a9-3221-4f81-b5d9-0bed032cc9e7 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b" status: 200 len: 1265 microversion: 2.1 time: 0.155918 May 26 15:23:56.380986 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 585/1143] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:56 2022] GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:23:57.396928 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ed56d831-fd35-4b58-a062-b4f114b9542f tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:57.397615 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ed56d831-fd35-4b58-a062-b4f114b9542f tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 5d1d8945-5896-4ef2-9033-3b091083a15b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:57.399629 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=2 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:23:57.406853 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ed56d831-fd35-4b58-a062-b4f114b9542f tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:57.407338 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ed56d831-fd35-4b58-a062-b4f114b9542f tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:57.408131 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ed56d831-fd35-4b58-a062-b4f114b9542f tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:57.408683 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ed56d831-fd35-4b58-a062-b4f114b9542f tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:57.545381 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ed56d831-fd35-4b58-a062-b4f114b9542f tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:57.553005 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ed56d831-fd35-4b58-a062-b4f114b9542f tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b" status: 200 len: 1265 microversion: 2.1 time: 0.159929 May 26 15:23:57.553584 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 559/1144] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:57 2022] GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:58.569942 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-7be6f590-8881-4678-b7c7-926c4abb21a8 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:58.570558 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-7be6f590-8881-4678-b7c7-926c4abb21a8 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 5d1d8945-5896-4ef2-9033-3b091083a15b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:58.577763 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7be6f590-8881-4678-b7c7-926c4abb21a8 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:58.578217 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7be6f590-8881-4678-b7c7-926c4abb21a8 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:58.578986 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7be6f590-8881-4678-b7c7-926c4abb21a8 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:58.579453 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7be6f590-8881-4678-b7c7-926c4abb21a8 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:58.711450 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-7be6f590-8881-4678-b7c7-926c4abb21a8 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:58.719652 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-7be6f590-8881-4678-b7c7-926c4abb21a8 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b" status: 200 len: 1265 microversion: 2.1 time: 0.153635 May 26 15:23:58.720222 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 586/1145] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:58 2022] GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:23:59.737268 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-7164fea7-c01c-4a35-ad6a-434b36d19cdd tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:23:59.737879 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-7164fea7-c01c-4a35-ad6a-434b36d19cdd tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 5d1d8945-5896-4ef2-9033-3b091083a15b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:23:59.744540 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7164fea7-c01c-4a35-ad6a-434b36d19cdd tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:59.744989 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7164fea7-c01c-4a35-ad6a-434b36d19cdd tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:59.745750 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7164fea7-c01c-4a35-ad6a-434b36d19cdd tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:23:59.746185 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7164fea7-c01c-4a35-ad6a-434b36d19cdd tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:23:59.876937 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7164fea7-c01c-4a35-ad6a-434b36d19cdd tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:23:59.884380 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-7164fea7-c01c-4a35-ad6a-434b36d19cdd tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b" status: 200 len: 1265 microversion: 2.1 time: 0.151024 May 26 15:23:59.885590 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 560/1146] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:23:59 2022] GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:24:00.902592 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-ed9d8990-16d5-4001-85a0-dc2d1681d794 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:00.903179 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-ed9d8990-16d5-4001-85a0-dc2d1681d794 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 5d1d8945-5896-4ef2-9033-3b091083a15b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:00.905491 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:24:00.910861 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ed9d8990-16d5-4001-85a0-dc2d1681d794 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:00.911346 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ed9d8990-16d5-4001-85a0-dc2d1681d794 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:00.912114 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ed9d8990-16d5-4001-85a0-dc2d1681d794 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:00.912551 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ed9d8990-16d5-4001-85a0-dc2d1681d794 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:00.918171 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:24:01.051251 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-ed9d8990-16d5-4001-85a0-dc2d1681d794 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:24:01.058728 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-ed9d8990-16d5-4001-85a0-dc2d1681d794 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b" status: 200 len: 1265 microversion: 2.1 time: 0.160650 May 26 15:24:01.059318 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 587/1147] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:24:00 2022] GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:24:02.074934 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ddc2432e-20d6-4495-8f6e-1c9f31de4ac2 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:02.075578 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ddc2432e-20d6-4495-8f6e-1c9f31de4ac2 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 5d1d8945-5896-4ef2-9033-3b091083a15b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:02.082043 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ddc2432e-20d6-4495-8f6e-1c9f31de4ac2 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:02.082490 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ddc2432e-20d6-4495-8f6e-1c9f31de4ac2 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:02.083280 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ddc2432e-20d6-4495-8f6e-1c9f31de4ac2 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:02.083719 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ddc2432e-20d6-4495-8f6e-1c9f31de4ac2 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:02.214145 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ddc2432e-20d6-4495-8f6e-1c9f31de4ac2 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:24:02.221617 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ddc2432e-20d6-4495-8f6e-1c9f31de4ac2 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b" status: 200 len: 1265 microversion: 2.1 time: 0.150511 May 26 15:24:02.222179 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 561/1148] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:24:02 2022] GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:24:03.239544 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-ca7c326b-946b-4c71-a222-b23fd0c8082e tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:03.240155 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-ca7c326b-946b-4c71-a222-b23fd0c8082e tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 5d1d8945-5896-4ef2-9033-3b091083a15b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:03.247520 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ca7c326b-946b-4c71-a222-b23fd0c8082e tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:03.247991 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ca7c326b-946b-4c71-a222-b23fd0c8082e tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:03.248761 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ca7c326b-946b-4c71-a222-b23fd0c8082e tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:03.249204 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ca7c326b-946b-4c71-a222-b23fd0c8082e tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:03.381740 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-ca7c326b-946b-4c71-a222-b23fd0c8082e tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:24:03.389508 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-ca7c326b-946b-4c71-a222-b23fd0c8082e tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b" status: 200 len: 1265 microversion: 2.1 time: 0.154184 May 26 15:24:03.390080 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 588/1149] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:24:03 2022] GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:24:04.406860 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-5883f390-e912-4684-9852-00c5ee4fe2e5 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:04.407472 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-5883f390-e912-4684-9852-00c5ee4fe2e5 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 5d1d8945-5896-4ef2-9033-3b091083a15b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:04.413999 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5883f390-e912-4684-9852-00c5ee4fe2e5 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:04.414450 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5883f390-e912-4684-9852-00c5ee4fe2e5 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:04.415245 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5883f390-e912-4684-9852-00c5ee4fe2e5 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:04.415883 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5883f390-e912-4684-9852-00c5ee4fe2e5 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:04.546391 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-5883f390-e912-4684-9852-00c5ee4fe2e5 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:24:04.553870 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-5883f390-e912-4684-9852-00c5ee4fe2e5 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b" status: 200 len: 1265 microversion: 2.1 time: 0.151061 May 26 15:24:04.554432 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 562/1150] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:24:04 2022] GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:24:05.571146 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-1461bbf1-2a44-450e-9c13-8565988a1494 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:05.571723 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-1461bbf1-2a44-450e-9c13-8565988a1494 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 5d1d8945-5896-4ef2-9033-3b091083a15b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:05.578633 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1461bbf1-2a44-450e-9c13-8565988a1494 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:05.579098 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1461bbf1-2a44-450e-9c13-8565988a1494 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:05.579901 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1461bbf1-2a44-450e-9c13-8565988a1494 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:05.580336 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-1461bbf1-2a44-450e-9c13-8565988a1494 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:05.709313 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-1461bbf1-2a44-450e-9c13-8565988a1494 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:24:05.717715 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-1461bbf1-2a44-450e-9c13-8565988a1494 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b" status: 200 len: 1265 microversion: 2.1 time: 0.150597 May 26 15:24:05.718280 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 589/1151] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:24:05 2022] GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:24:06.734517 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-0a31d347-4737-4c29-8004-f39a397778b8 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:06.735079 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-0a31d347-4737-4c29-8004-f39a397778b8 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 5d1d8945-5896-4ef2-9033-3b091083a15b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:06.741653 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0a31d347-4737-4c29-8004-f39a397778b8 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:06.742098 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0a31d347-4737-4c29-8004-f39a397778b8 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:06.742849 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0a31d347-4737-4c29-8004-f39a397778b8 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:06.743318 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0a31d347-4737-4c29-8004-f39a397778b8 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:06.877389 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-0a31d347-4737-4c29-8004-f39a397778b8 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:24:06.884968 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-0a31d347-4737-4c29-8004-f39a397778b8 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b" status: 200 len: 1265 microversion: 2.1 time: 0.154324 May 26 15:24:06.885544 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 563/1152] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:24:06 2022] GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:24:07.901840 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-5e386ca9-82eb-454b-9405-b94fc3dc32ed tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:07.902379 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-5e386ca9-82eb-454b-9405-b94fc3dc32ed tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 5d1d8945-5896-4ef2-9033-3b091083a15b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:07.909061 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5e386ca9-82eb-454b-9405-b94fc3dc32ed tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:07.909516 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5e386ca9-82eb-454b-9405-b94fc3dc32ed tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:07.910294 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5e386ca9-82eb-454b-9405-b94fc3dc32ed tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:07.910750 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-5e386ca9-82eb-454b-9405-b94fc3dc32ed tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:08.047148 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-5e386ca9-82eb-454b-9405-b94fc3dc32ed tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:24:08.054916 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-5e386ca9-82eb-454b-9405-b94fc3dc32ed tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b" status: 200 len: 1265 microversion: 2.1 time: 0.157101 May 26 15:24:08.055501 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 590/1153] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:24:07 2022] GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:24:09.072807 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-dbb574f4-17f5-489b-8129-a7175362ad69 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:09.073496 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-dbb574f4-17f5-489b-8129-a7175362ad69 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 5d1d8945-5896-4ef2-9033-3b091083a15b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:09.080050 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dbb574f4-17f5-489b-8129-a7175362ad69 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:09.080495 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dbb574f4-17f5-489b-8129-a7175362ad69 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:09.081256 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dbb574f4-17f5-489b-8129-a7175362ad69 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:09.081684 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-dbb574f4-17f5-489b-8129-a7175362ad69 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:09.213733 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-dbb574f4-17f5-489b-8129-a7175362ad69 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:24:09.221146 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-dbb574f4-17f5-489b-8129-a7175362ad69 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b" status: 200 len: 1265 microversion: 2.1 time: 0.152836 May 26 15:24:09.221710 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 564/1154] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:24:09 2022] GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:24:10.238571 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-f6f6bb07-c88a-4eca-aaa7-ad272ef88032 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:10.239148 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-f6f6bb07-c88a-4eca-aaa7-ad272ef88032 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 5d1d8945-5896-4ef2-9033-3b091083a15b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:10.245862 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f6f6bb07-c88a-4eca-aaa7-ad272ef88032 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:10.246313 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f6f6bb07-c88a-4eca-aaa7-ad272ef88032 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:10.247081 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f6f6bb07-c88a-4eca-aaa7-ad272ef88032 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:10.247597 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f6f6bb07-c88a-4eca-aaa7-ad272ef88032 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:10.376897 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-f6f6bb07-c88a-4eca-aaa7-ad272ef88032 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:24:10.385012 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-f6f6bb07-c88a-4eca-aaa7-ad272ef88032 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b" status: 200 len: 1265 microversion: 2.1 time: 0.150070 May 26 15:24:10.385618 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 591/1155] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:24:10 2022] GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:24:11.339049 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-68dc04f2-91b1-42c6-a98f-015f6f9c9708 req-2132c0c9-c47b-446a-ac8a-6d01cb504529 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d1d8945-5896-4ef2-9033-3b091083a15b", "name": "network-vif-plugged", "status": "completed", "tag": "2edf9591-6b8d-40a5-bf70-1046a458a5d4"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:24:11.347647 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-68dc04f2-91b1-42c6-a98f-015f6f9c9708 req-2132c0c9-c47b-446a-ac8a-6d01cb504529 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:11.348093 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-68dc04f2-91b1-42c6-a98f-015f6f9c9708 req-2132c0c9-c47b-446a-ac8a-6d01cb504529 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:11.359565 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-68dc04f2-91b1-42c6-a98f-015f6f9c9708 req-2132c0c9-c47b-446a-ac8a-6d01cb504529 service nova] Creating event network-vif-plugged:2edf9591-6b8d-40a5-bf70-1046a458a5d4 for instance 5d1d8945-5896-4ef2-9033-3b091083a15b on hv-cinder-84301 May 26 15:24:11.364496 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-68dc04f2-91b1-42c6-a98f-015f6f9c9708 req-2132c0c9-c47b-446a-ac8a-6d01cb504529 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030225 May 26 15:24:11.365102 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 565/1156] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:24:11.402977 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-85e5f5ff-9f43-436e-b587-f01e1b120cb1 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:11.403681 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-85e5f5ff-9f43-436e-b587-f01e1b120cb1 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 5d1d8945-5896-4ef2-9033-3b091083a15b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:11.410383 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-85e5f5ff-9f43-436e-b587-f01e1b120cb1 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:11.410838 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-85e5f5ff-9f43-436e-b587-f01e1b120cb1 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:11.411671 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-85e5f5ff-9f43-436e-b587-f01e1b120cb1 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:11.412112 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-85e5f5ff-9f43-436e-b587-f01e1b120cb1 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:11.555535 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-85e5f5ff-9f43-436e-b587-f01e1b120cb1 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:24:11.566362 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-85e5f5ff-9f43-436e-b587-f01e1b120cb1 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b" status: 200 len: 1265 microversion: 2.1 time: 0.168400 May 26 15:24:11.576247 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 592/1157] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:24:11 2022] GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:24:12.584989 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-10d34265-d27c-4213-bcea-49daa2798aaa tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:12.585700 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-10d34265-d27c-4213-bcea-49daa2798aaa tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 5d1d8945-5896-4ef2-9033-3b091083a15b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:12.592434 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-10d34265-d27c-4213-bcea-49daa2798aaa tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:12.592872 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-10d34265-d27c-4213-bcea-49daa2798aaa tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:12.593619 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-10d34265-d27c-4213-bcea-49daa2798aaa tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:12.594053 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-10d34265-d27c-4213-bcea-49daa2798aaa tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:12.727822 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-10d34265-d27c-4213-bcea-49daa2798aaa tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:24:12.739336 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-10d34265-d27c-4213-bcea-49daa2798aaa tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b" status: 200 len: 1265 microversion: 2.1 time: 0.159019 May 26 15:24:12.739921 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 566/1158] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:24:12 2022] GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:24:13.756576 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-42ad931d-c5ad-4cf2-9f08-d074cb9ccfe4 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:13.757504 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-42ad931d-c5ad-4cf2-9f08-d074cb9ccfe4 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 5d1d8945-5896-4ef2-9033-3b091083a15b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:13.764518 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-42ad931d-c5ad-4cf2-9f08-d074cb9ccfe4 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:13.764961 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-42ad931d-c5ad-4cf2-9f08-d074cb9ccfe4 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:13.765721 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-42ad931d-c5ad-4cf2-9f08-d074cb9ccfe4 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:13.766175 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-42ad931d-c5ad-4cf2-9f08-d074cb9ccfe4 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:13.783478 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-cbfc5f47-47dc-4762-9597-15ed34f198d1 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:13.784060 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-cbfc5f47-47dc-4762-9597-15ed34f198d1 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:13.791213 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cbfc5f47-47dc-4762-9597-15ed34f198d1 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:13.791890 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cbfc5f47-47dc-4762-9597-15ed34f198d1 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:13.792730 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cbfc5f47-47dc-4762-9597-15ed34f198d1 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:13.793237 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cbfc5f47-47dc-4762-9597-15ed34f198d1 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:13.878786 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.objects.instance [None req-cbfc5f47-47dc-4762-9597-15ed34f198d1 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lazy-loading 'services' on Instance uuid 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19 {{(pid=117798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:24:13.902552 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-42ad931d-c5ad-4cf2-9f08-d074cb9ccfe4 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:24:13.910773 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-42ad931d-c5ad-4cf2-9f08-d074cb9ccfe4 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b" status: 200 len: 1452 microversion: 2.1 time: 0.158076 May 26 15:24:13.911373 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 593/1159] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:24:13 2022] GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:24:13.926199 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-98998cb5-0ec0-4783-8f3b-ddc4a5b077e0 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:13.926834 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-98998cb5-0ec0-4783-8f3b-ddc4a5b077e0 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 5d1d8945-5896-4ef2-9033-3b091083a15b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:13.933228 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-98998cb5-0ec0-4783-8f3b-ddc4a5b077e0 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:13.933810 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-98998cb5-0ec0-4783-8f3b-ddc4a5b077e0 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:13.934588 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-98998cb5-0ec0-4783-8f3b-ddc4a5b077e0 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:13.935054 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-98998cb5-0ec0-4783-8f3b-ddc4a5b077e0 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:13.954743 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-cbfc5f47-47dc-4762-9597-15ed34f198d1 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "DELETE /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19/os-volume_attachments/4f8755df-5404-4550-863d-5c9c9330a757" status: 202 len: 0 microversion: 2.1 time: 0.175013 May 26 15:24:13.955416 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 567/1160] 10.222.0.45 () {58 vars in 1415 bytes} [Thu May 26 15:24:13 2022] DELETE /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19/os-volume_attachments/4f8755df-5404-4550-863d-5c9c9330a757 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 15:24:14.080481 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-98998cb5-0ec0-4783-8f3b-ddc4a5b077e0 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:24:14.088677 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-98998cb5-0ec0-4783-8f3b-ddc4a5b077e0 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b" status: 200 len: 1452 microversion: 2.1 time: 0.166018 May 26 15:24:14.089242 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 594/1161] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:24:13 2022] GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b => generated 1452 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:24:15.099288 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-5a533a86-f7e9-432d-8329-ce0504b0abf1 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:15.099882 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-5a533a86-f7e9-432d-8329-ce0504b0abf1 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:15.106460 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5a533a86-f7e9-432d-8329-ce0504b0abf1 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:15.106974 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5a533a86-f7e9-432d-8329-ce0504b0abf1 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:15.107794 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5a533a86-f7e9-432d-8329-ce0504b0abf1 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:15.108237 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-5a533a86-f7e9-432d-8329-ce0504b0abf1 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:15.135596 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-5a533a86-f7e9-432d-8329-ce0504b0abf1 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19] Going to try to terminate instance {{(pid=117798) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:24:15.218475 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-5a533a86-f7e9-432d-8329-ce0504b0abf1 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "DELETE /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19" status: 204 len: 0 microversion: 2.1 time: 0.123569 May 26 15:24:15.219183 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 568/1162] 10.222.0.45 () {58 vars in 1238 bytes} [Thu May 26 15:24:15 2022] DELETE /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:24:15.227604 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-ba70b90e-97f2-4a17-b2b6-4e8e1d78f9d7 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:15.228459 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-ba70b90e-97f2-4a17-b2b6-4e8e1d78f9d7 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:15.236164 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ba70b90e-97f2-4a17-b2b6-4e8e1d78f9d7 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:15.236608 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ba70b90e-97f2-4a17-b2b6-4e8e1d78f9d7 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:15.237375 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ba70b90e-97f2-4a17-b2b6-4e8e1d78f9d7 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:15.237804 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ba70b90e-97f2-4a17-b2b6-4e8e1d78f9d7 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:15.451199 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-ba70b90e-97f2-4a17-b2b6-4e8e1d78f9d7 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:24:15.459058 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-ba70b90e-97f2-4a17-b2b6-4e8e1d78f9d7 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19" status: 200 len: 1514 microversion: 2.1 time: 0.235365 May 26 15:24:15.459667 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 595/1163] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:24:15 2022] GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19 => generated 1514 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:24:16.236115 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-8f0f9331-8c52-479d-bc28-cb69034419f7 req-2c1ce9d3-eaaa-4b55-a511-511cd00b2453 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d1d8945-5896-4ef2-9033-3b091083a15b", "tag": "2edf9591-6b8d-40a5-bf70-1046a458a5d4"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:24:16.246745 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-8f0f9331-8c52-479d-bc28-cb69034419f7 req-2c1ce9d3-eaaa-4b55-a511-511cd00b2453 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:16.247322 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-8f0f9331-8c52-479d-bc28-cb69034419f7 req-2c1ce9d3-eaaa-4b55-a511-511cd00b2453 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:16.260215 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-8f0f9331-8c52-479d-bc28-cb69034419f7 req-2c1ce9d3-eaaa-4b55-a511-511cd00b2453 service nova] Creating event network-changed:2edf9591-6b8d-40a5-bf70-1046a458a5d4 for instance 5d1d8945-5896-4ef2-9033-3b091083a15b on hv-cinder-84301 May 26 15:24:16.265017 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-8f0f9331-8c52-479d-bc28-cb69034419f7 req-2c1ce9d3-eaaa-4b55-a511-511cd00b2453 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032970 May 26 15:24:16.265814 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 569/1164] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:24:16.476909 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-6a047e08-619d-4b1b-9184-9322a9a26d61 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:16.477635 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-6a047e08-619d-4b1b-9184-9322a9a26d61 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:16.484893 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6a047e08-619d-4b1b-9184-9322a9a26d61 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:16.485439 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6a047e08-619d-4b1b-9184-9322a9a26d61 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:16.486277 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6a047e08-619d-4b1b-9184-9322a9a26d61 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:16.486784 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6a047e08-619d-4b1b-9184-9322a9a26d61 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:16.626780 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-6a047e08-619d-4b1b-9184-9322a9a26d61 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:24:16.634732 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-6a047e08-619d-4b1b-9184-9322a9a26d61 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19" status: 200 len: 1514 microversion: 2.1 time: 0.161514 May 26 15:24:16.635822 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 596/1165] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:24:16 2022] GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:24:17.653732 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-3b591cf0-f890-44d3-9494-ba40c1a5ebd3 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:17.654459 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-3b591cf0-f890-44d3-9494-ba40c1a5ebd3 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:17.660537 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3b591cf0-f890-44d3-9494-ba40c1a5ebd3 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:17.660973 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3b591cf0-f890-44d3-9494-ba40c1a5ebd3 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:17.661759 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3b591cf0-f890-44d3-9494-ba40c1a5ebd3 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:17.662188 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3b591cf0-f890-44d3-9494-ba40c1a5ebd3 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:17.796360 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-3b591cf0-f890-44d3-9494-ba40c1a5ebd3 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:24:17.804351 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-3b591cf0-f890-44d3-9494-ba40c1a5ebd3 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19" status: 200 len: 1514 microversion: 2.1 time: 0.155754 May 26 15:24:17.805018 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 570/1166] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:24:17 2022] GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:24:17.905724 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-93a6d4a2-fa06-41be-b4bd-77a5463e4948 req-13212b33-5c24-4f51-9578-510ee024963e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41f4f35e-512c-4b29-b7a7-cc8b38ab3a19", "name": "network-vif-deleted", "tag": "7b251101-69e7-4bf0-a53f-1fbaa6678c48"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:24:17.915105 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-93a6d4a2-fa06-41be-b4bd-77a5463e4948 req-13212b33-5c24-4f51-9578-510ee024963e service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:17.916083 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-93a6d4a2-fa06-41be-b4bd-77a5463e4948 req-13212b33-5c24-4f51-9578-510ee024963e service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:17.927694 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-93a6d4a2-fa06-41be-b4bd-77a5463e4948 req-13212b33-5c24-4f51-9578-510ee024963e service nova] Creating event network-vif-deleted:7b251101-69e7-4bf0-a53f-1fbaa6678c48 for instance 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19 on hv-cinder-84301 May 26 15:24:17.934941 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-93a6d4a2-fa06-41be-b4bd-77a5463e4948 req-13212b33-5c24-4f51-9578-510ee024963e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032718 May 26 15:24:17.935688 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 597/1167] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:24:18.821977 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c297bebb-5126-4d3b-9532-57852501acd6 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:18.822551 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c297bebb-5126-4d3b-9532-57852501acd6 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:18.829008 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c297bebb-5126-4d3b-9532-57852501acd6 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:18.829494 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c297bebb-5126-4d3b-9532-57852501acd6 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:18.830291 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c297bebb-5126-4d3b-9532-57852501acd6 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:18.830729 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c297bebb-5126-4d3b-9532-57852501acd6 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:18.844763 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-c297bebb-5126-4d3b-9532-57852501acd6 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] HTTP exception thrown: Instance 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19 could not be found. May 26 15:24:18.846422 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c297bebb-5126-4d3b-9532-57852501acd6 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Request method failure captured: May 26 15:24:18.846422 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: request: GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19 HTTP/1.1 May 26 15:24:18.846422 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept: application/json May 26 15:24:18.846422 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity May 26 15:24:18.846422 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Connection: close May 26 15:24:18.846422 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Length: 0 May 26 15:24:18.846422 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Type: application/json May 26 15:24:18.846422 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Host: 10.222.0.45 May 26 15:24:18.846422 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None May 26 15:24:18.846422 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 May 26 15:24:18.846422 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABij5s_bchwII1VIPrM8Lokb8BFRmphzRhWZY1oJqoa9Ht-uWopJXbN8UVOT8G-mitP7a5IKoRZS6Xskn8uSPCkC2aKPTeHdc8mzzlgvg3AlFj4Mm2l12lxBpXOzVthRfsKJEtbH_ztbvezTmky4pgvxWN-jfcIvb9RPnRCKp7rvQFxCmw May 26 15:24:18.846422 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Id: None May 26 15:24:18.846422 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Name: None May 26 15:24:18.846422 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed May 26 15:24:18.846422 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True May 26 15:24:18.846422 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default May 26 15:24:18.846422 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default May 26 15:24:18.846422 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Id: ef506c64b2d442d299e2eb16910be975 May 26 15:24:18.846422 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-VolumesSnapshotTestJSON-564496835 May 26 15:24:18.846422 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Role: reader,member May 26 15:24:18.846422 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Roles: reader,member May 26 15:24:18.848252 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ef506c64b2d442d299e2eb16910be975"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ef506c64b2d442d299e2eb16910be975"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ef506c64b2d442d299e2eb16910be975"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ef506c64b2d442d299e2eb16910be975"}]}] May 26 15:24:18.848252 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-VolumesSnapshotTestJSON-564496835 May 26 15:24:18.848252 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Id: ef506c64b2d442d299e2eb16910be975 May 26 15:24:18.848252 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-564496835 May 26 15:24:18.848252 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User: tempest-VolumesSnapshotTestJSON-564496835-project May 26 15:24:18.848252 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default May 26 15:24:18.848252 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default May 26 15:24:18.848252 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Id: 65439e25dc88400dac2c457aa5ed139e May 26 15:24:18.848252 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-VolumesSnapshotTestJSON-564496835-project May 26 15:24:18.848252 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: method: > May 26 15:24:18.848252 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: exception: Instance 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19 could not be found. May 26 15:24:18.848252 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: action_args: {'id': '41f4f35e-512c-4b29-b7a7-cc8b38ab3a19'} May 26 15:24:18.849255 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:24:18.849255 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:24:18.849255 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:24:18.849255 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:24:18.849255 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:24:18.849255 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:24:18.849255 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:24:18.849255 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:24:18.849255 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:24:18.849255 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:24:18.849255 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19 could not be found. May 26 15:24:18.849255 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:24:18.849255 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:24:18.849255 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:24:18.849255 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:24:18.849255 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:24:18.849255 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:24:18.849255 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:24:18.849255 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:24:18.849255 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:24:18.850899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:24:18.850899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:24:18.850899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:24:18.850899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:24:18.850899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:24:18.850899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:24:18.850899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:24:18.850899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19 could not be found. May 26 15:24:18.850899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:24:18.850899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:24:18.850899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:24:18.850899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:24:18.850899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:24:18.850899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:24:18.850899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:24:18.850899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:24:18.850899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19 could not be found. May 26 15:24:18.850899 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:24:18.852324 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c297bebb-5126-4d3b-9532-57852501acd6 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Returning 404 to user: Instance 41f4f35e-512c-4b29-b7a7-cc8b38ab3a19 could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:24:18.852324 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c297bebb-5126-4d3b-9532-57852501acd6 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19" status: 404 len: 111 microversion: 2.1 time: 0.030009 May 26 15:24:18.852324 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 571/1168] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:24:18 2022] GET /compute/v2.1/servers/41f4f35e-512c-4b29-b7a7-cc8b38ab3a19 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:24:33.038512 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_api:SELECT=21 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:24:33.039284 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=61 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:24:33.043856 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-18391783-9a23-4187-9bcc-eb7d47c2a92b tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1746527061", "imageRef": "5b5a68b4-38e3-4f05-b97f-4339d6752e34", "flavorRef": "452", "networks": [{"uuid": "44c533c6-3650-4955-91c9-fafb9124ee77"}]}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:24:33.105384 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.network.neutron [None req-18391783-9a23-4187-9bcc-eb7d47c2a92b tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] validate_networks() for [('44c533c6-3650-4955-91c9-fafb9124ee77', None, None, None, None, None)] {{(pid=117799) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:24:33.449422 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-18391783-9a23-4187-9bcc-eb7d47c2a92b tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Flavor limits 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:24:33.449846 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-18391783-9a23-4187-9bcc-eb7d47c2a92b tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Image limits 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:24:33.450321 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-18391783-9a23-4187-9bcc-eb7d47c2a92b tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Flavor pref 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:24:33.450732 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-18391783-9a23-4187-9bcc-eb7d47c2a92b tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Image pref 0:0:0 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:24:33.451167 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.virt.hardware [None req-18391783-9a23-4187-9bcc-eb7d47c2a92b tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:24:33.459949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-18391783-9a23-4187-9bcc-eb7d47c2a92b tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:33.460392 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-18391783-9a23-4187-9bcc-eb7d47c2a92b tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:33.461186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-18391783-9a23-4187-9bcc-eb7d47c2a92b tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:33.461654 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-18391783-9a23-4187-9bcc-eb7d47c2a92b tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:33.478840 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.quota [None req-18391783-9a23-4187-9bcc-eb7d47c2a92b tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Getting quotas for project ef506c64b2d442d299e2eb16910be975. Resources: {'cores', 'ram', 'instances'} {{(pid=117799) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:24:33.482779 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.quota [None req-18391783-9a23-4187-9bcc-eb7d47c2a92b tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Getting quotas for user 65439e25dc88400dac2c457aa5ed139e and project ef506c64b2d442d299e2eb16910be975. Resources: {'cores', 'ram', 'instances'} {{(pid=117799) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:24:33.494114 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-18391783-9a23-4187-9bcc-eb7d47c2a92b tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Going to run 1 instances... {{(pid=117799) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:24:33.496590 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-18391783-9a23-4187-9bcc-eb7d47c2a92b tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5b5a68b4-38e3-4f05-b97f-4339d6752e34',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117799) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:24:33.541680 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-18391783-9a23-4187-9bcc-eb7d47c2a92b tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.504718 May 26 15:24:33.542318 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 598/1169] 10.222.0.45 () {60 vars in 1146 bytes} [Thu May 26 15:24:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 15:24:33.552298 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ced8ca31-11ad-416e-bff0-205c824e2d36 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:33.553074 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ced8ca31-11ad-416e-bff0-205c824e2d36 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:33.556380 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:24:33.557160 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:24:33.611249 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-ced8ca31-11ad-416e-bff0-205c824e2d36 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:24:33.618901 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ced8ca31-11ad-416e-bff0-205c824e2d36 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8" status: 200 len: 1219 microversion: 2.1 time: 0.069712 May 26 15:24:33.619740 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 572/1170] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:24:33 2022] GET /compute/v2.1/servers/3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:24:34.637366 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-c49ef13c-26d6-41c2-ab46-4431b6370082 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:34.637989 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-c49ef13c-26d6-41c2-ab46-4431b6370082 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:34.644692 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c49ef13c-26d6-41c2-ab46-4431b6370082 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:34.645121 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c49ef13c-26d6-41c2-ab46-4431b6370082 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:34.645879 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c49ef13c-26d6-41c2-ab46-4431b6370082 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:34.646314 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c49ef13c-26d6-41c2-ab46-4431b6370082 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:34.711412 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-c49ef13c-26d6-41c2-ab46-4431b6370082 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:24:34.720634 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-c49ef13c-26d6-41c2-ab46-4431b6370082 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8" status: 200 len: 1271 microversion: 2.1 time: 0.088182 May 26 15:24:34.721402 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 599/1171] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:24:34 2022] GET /compute/v2.1/servers/3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8 => generated 1271 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:24:35.738218 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-077c997d-374e-430a-8fc3-e6434ff7f629 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:35.738841 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-077c997d-374e-430a-8fc3-e6434ff7f629 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:35.746228 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-077c997d-374e-430a-8fc3-e6434ff7f629 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:35.746714 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-077c997d-374e-430a-8fc3-e6434ff7f629 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:35.747516 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-077c997d-374e-430a-8fc3-e6434ff7f629 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:35.747968 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-077c997d-374e-430a-8fc3-e6434ff7f629 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:35.887064 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-077c997d-374e-430a-8fc3-e6434ff7f629 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:24:35.894849 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-077c997d-374e-430a-8fc3-e6434ff7f629 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8" status: 200 len: 1319 microversion: 2.1 time: 0.160622 May 26 15:24:35.895510 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 573/1172] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:24:35 2022] GET /compute/v2.1/servers/3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:24:36.046497 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-c686b057-1f84-45f4-9a15-9f5c6867247a req-35ed061c-d38a-46be-a5cb-eaa6a040ca27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8", "tag": "39b3f582-97a3-4adb-9564-f7b1e24fceb2"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:24:36.055026 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-c686b057-1f84-45f4-9a15-9f5c6867247a req-35ed061c-d38a-46be-a5cb-eaa6a040ca27 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:36.055737 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-c686b057-1f84-45f4-9a15-9f5c6867247a req-35ed061c-d38a-46be-a5cb-eaa6a040ca27 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:36.072818 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-c686b057-1f84-45f4-9a15-9f5c6867247a req-35ed061c-d38a-46be-a5cb-eaa6a040ca27 service nova] Creating event network-changed:39b3f582-97a3-4adb-9564-f7b1e24fceb2 for instance 3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8 on hv-cinder-84301 May 26 15:24:36.077964 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-c686b057-1f84-45f4-9a15-9f5c6867247a req-35ed061c-d38a-46be-a5cb-eaa6a040ca27 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037406 May 26 15:24:36.078927 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 600/1173] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:24:36.912486 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-04acd074-5186-40db-8791-9c1e1fb67f5c tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:36.913093 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-04acd074-5186-40db-8791-9c1e1fb67f5c tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:36.920316 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-04acd074-5186-40db-8791-9c1e1fb67f5c tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:36.920764 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-04acd074-5186-40db-8791-9c1e1fb67f5c tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:36.921530 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-04acd074-5186-40db-8791-9c1e1fb67f5c tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:36.921964 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-04acd074-5186-40db-8791-9c1e1fb67f5c tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:37.053827 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-04acd074-5186-40db-8791-9c1e1fb67f5c tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:24:37.061734 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-04acd074-5186-40db-8791-9c1e1fb67f5c tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8" status: 200 len: 1319 microversion: 2.1 time: 0.153130 May 26 15:24:37.062299 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 574/1174] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:24:36 2022] GET /compute/v2.1/servers/3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:24:38.082237 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-b8cd2c8d-7e4d-449a-99b3-d3b2ce51bb1a tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:38.082935 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-b8cd2c8d-7e4d-449a-99b3-d3b2ce51bb1a tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:38.090714 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b8cd2c8d-7e4d-449a-99b3-d3b2ce51bb1a tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:38.091203 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b8cd2c8d-7e4d-449a-99b3-d3b2ce51bb1a tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:38.091970 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b8cd2c8d-7e4d-449a-99b3-d3b2ce51bb1a tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:38.092405 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b8cd2c8d-7e4d-449a-99b3-d3b2ce51bb1a tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:38.224484 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-b8cd2c8d-7e4d-449a-99b3-d3b2ce51bb1a tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:24:38.232089 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-b8cd2c8d-7e4d-449a-99b3-d3b2ce51bb1a tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8" status: 200 len: 1319 microversion: 2.1 time: 0.154068 May 26 15:24:38.232958 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 601/1175] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:24:38 2022] GET /compute/v2.1/servers/3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:24:39.249019 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-20aaa02e-9cf1-4564-aee3-68dae4573939 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:39.249621 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-20aaa02e-9cf1-4564-aee3-68dae4573939 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:39.256266 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-20aaa02e-9cf1-4564-aee3-68dae4573939 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:39.256733 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-20aaa02e-9cf1-4564-aee3-68dae4573939 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:39.257492 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-20aaa02e-9cf1-4564-aee3-68dae4573939 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:39.257920 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-20aaa02e-9cf1-4564-aee3-68dae4573939 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:39.389843 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-20aaa02e-9cf1-4564-aee3-68dae4573939 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:24:39.397708 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-20aaa02e-9cf1-4564-aee3-68dae4573939 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8" status: 200 len: 1319 microversion: 2.1 time: 0.152477 May 26 15:24:39.398348 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 575/1176] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:24:39 2022] GET /compute/v2.1/servers/3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:24:40.416421 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-47a2f9ab-2b77-49bb-9fa1-9e9f03dc596b tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:40.417035 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-47a2f9ab-2b77-49bb-9fa1-9e9f03dc596b tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:40.423724 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-47a2f9ab-2b77-49bb-9fa1-9e9f03dc596b tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:40.424169 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-47a2f9ab-2b77-49bb-9fa1-9e9f03dc596b tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:40.424931 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-47a2f9ab-2b77-49bb-9fa1-9e9f03dc596b tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:40.425366 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-47a2f9ab-2b77-49bb-9fa1-9e9f03dc596b tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:40.563079 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-47a2f9ab-2b77-49bb-9fa1-9e9f03dc596b tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:24:40.572360 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-47a2f9ab-2b77-49bb-9fa1-9e9f03dc596b tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8" status: 200 len: 1319 microversion: 2.1 time: 0.160617 May 26 15:24:40.573551 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 602/1177] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:24:40 2022] GET /compute/v2.1/servers/3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:24:41.590821 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-7c64019d-b15b-4334-8751-8eff2f6edb75 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:41.591440 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-7c64019d-b15b-4334-8751-8eff2f6edb75 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:41.597674 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7c64019d-b15b-4334-8751-8eff2f6edb75 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:41.598123 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7c64019d-b15b-4334-8751-8eff2f6edb75 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:41.598888 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7c64019d-b15b-4334-8751-8eff2f6edb75 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:41.599366 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-7c64019d-b15b-4334-8751-8eff2f6edb75 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:41.732385 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-7c64019d-b15b-4334-8751-8eff2f6edb75 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:24:41.740178 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-7c64019d-b15b-4334-8751-8eff2f6edb75 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8" status: 200 len: 1319 microversion: 2.1 time: 0.154107 May 26 15:24:41.740818 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 576/1178] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:24:41 2022] GET /compute/v2.1/servers/3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:24:42.303081 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-8243c6bd-aef0-4618-9e1a-34afad112d5e req-b6ae2e20-eeee-4434-ac9f-4ee28e9d10d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8", "name": "network-vif-plugged", "status": "completed", "tag": "39b3f582-97a3-4adb-9564-f7b1e24fceb2"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:24:42.313316 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-8243c6bd-aef0-4618-9e1a-34afad112d5e req-b6ae2e20-eeee-4434-ac9f-4ee28e9d10d2 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:42.313899 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-8243c6bd-aef0-4618-9e1a-34afad112d5e req-b6ae2e20-eeee-4434-ac9f-4ee28e9d10d2 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:42.326716 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-8243c6bd-aef0-4618-9e1a-34afad112d5e req-b6ae2e20-eeee-4434-ac9f-4ee28e9d10d2 service nova] Creating event network-vif-plugged:39b3f582-97a3-4adb-9564-f7b1e24fceb2 for instance 3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8 on hv-cinder-84301 May 26 15:24:42.331907 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-8243c6bd-aef0-4618-9e1a-34afad112d5e req-b6ae2e20-eeee-4434-ac9f-4ee28e9d10d2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032907 May 26 15:24:42.333114 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 603/1179] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:24:42.757435 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-2396638e-c74d-4f51-88d5-9d77eb024c6a tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:42.757988 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-2396638e-c74d-4f51-88d5-9d77eb024c6a tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:42.764666 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2396638e-c74d-4f51-88d5-9d77eb024c6a tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:42.765109 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2396638e-c74d-4f51-88d5-9d77eb024c6a tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:42.765864 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2396638e-c74d-4f51-88d5-9d77eb024c6a tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:42.766294 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-2396638e-c74d-4f51-88d5-9d77eb024c6a tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:42.896906 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-2396638e-c74d-4f51-88d5-9d77eb024c6a tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:24:42.905280 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-2396638e-c74d-4f51-88d5-9d77eb024c6a tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8" status: 200 len: 1319 microversion: 2.1 time: 0.151777 May 26 15:24:42.905847 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 577/1180] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:24:42 2022] GET /compute/v2.1/servers/3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:24:43.922678 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-68835b26-a5d2-4bbf-9ad4-be177210dc01 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:43.923401 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-68835b26-a5d2-4bbf-9ad4-be177210dc01 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:43.925887 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell0:SELECT=2 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:24:43.926599 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell0:SELECT=6 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:24:43.934081 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-68835b26-a5d2-4bbf-9ad4-be177210dc01 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:43.934632 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-68835b26-a5d2-4bbf-9ad4-be177210dc01 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:43.935787 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-68835b26-a5d2-4bbf-9ad4-be177210dc01 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:43.936456 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-68835b26-a5d2-4bbf-9ad4-be177210dc01 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:44.081274 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-68835b26-a5d2-4bbf-9ad4-be177210dc01 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:24:44.089054 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-68835b26-a5d2-4bbf-9ad4-be177210dc01 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8" status: 200 len: 1319 microversion: 2.1 time: 0.170610 May 26 15:24:44.089627 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 604/1181] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:24:43 2022] GET /compute/v2.1/servers/3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:24:45.106351 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c7ef11fd-cd85-4c3a-bf1d-a8979da57cc3 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:45.107026 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c7ef11fd-cd85-4c3a-bf1d-a8979da57cc3 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:45.109082 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell0:SELECT=2 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:24:45.114778 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c7ef11fd-cd85-4c3a-bf1d-a8979da57cc3 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:45.115266 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c7ef11fd-cd85-4c3a-bf1d-a8979da57cc3 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:45.116027 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c7ef11fd-cd85-4c3a-bf1d-a8979da57cc3 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:45.116467 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c7ef11fd-cd85-4c3a-bf1d-a8979da57cc3 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:45.244170 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c7ef11fd-cd85-4c3a-bf1d-a8979da57cc3 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:24:45.251959 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c7ef11fd-cd85-4c3a-bf1d-a8979da57cc3 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8" status: 200 len: 1507 microversion: 2.1 time: 0.149847 May 26 15:24:45.252539 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 578/1182] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:24:45 2022] GET /compute/v2.1/servers/3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:24:45.269854 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-fc238d4d-dc23-44df-be98-265f145defc8 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9df0daaa-c086-42ad-9cf1-bf4b887f8d9c", "device": "/dev/sdb"}} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:24:45.271000 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-fc238d4d-dc23-44df-be98-265f145defc8 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:45.277490 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fc238d4d-dc23-44df-be98-265f145defc8 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:45.277935 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fc238d4d-dc23-44df-be98-265f145defc8 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:45.278693 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fc238d4d-dc23-44df-be98-265f145defc8 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:45.279152 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-fc238d4d-dc23-44df-be98-265f145defc8 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:45.525401 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-fc238d4d-dc23-44df-be98-265f145defc8 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "POST /compute/v2.1/servers/3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259457 May 26 15:24:45.526011 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 605/1183] 10.222.0.45 () {60 vars in 1322 bytes} [Thu May 26 15:24:45 2022] POST /compute/v2.1/servers/3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:25:08.956312 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f6929ed9-aabf-4109-b24a-008b6672b938 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:25:08.956832 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f6929ed9-aabf-4109-b24a-008b6672b938 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:25:08.959329 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=16 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:25:08.960017 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=36 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:25:08.965500 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f6929ed9-aabf-4109-b24a-008b6672b938 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:25:08.965936 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f6929ed9-aabf-4109-b24a-008b6672b938 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:25:08.966684 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f6929ed9-aabf-4109-b24a-008b6672b938 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:25:08.967130 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f6929ed9-aabf-4109-b24a-008b6672b938 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:25:09.050884 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.objects.instance [None req-f6929ed9-aabf-4109-b24a-008b6672b938 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lazy-loading 'services' on Instance uuid 3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8 {{(pid=117798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:25:09.124973 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f6929ed9-aabf-4109-b24a-008b6672b938 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "DELETE /compute/v2.1/servers/3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8/os-volume_attachments/9df0daaa-c086-42ad-9cf1-bf4b887f8d9c" status: 202 len: 0 microversion: 2.1 time: 0.172414 May 26 15:25:09.125561 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 579/1184] 10.222.0.45 () {58 vars in 1415 bytes} [Thu May 26 15:25:08 2022] DELETE /compute/v2.1/servers/3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8/os-volume_attachments/9df0daaa-c086-42ad-9cf1-bf4b887f8d9c => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:25:10.238352 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:25:10.239334 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:25:10.244079 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-45bb4bb1-bcf9-4696-a15a-3b2774d29ab4 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:25:10.244661 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-45bb4bb1-bcf9-4696-a15a-3b2774d29ab4 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:25:10.252137 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-45bb4bb1-bcf9-4696-a15a-3b2774d29ab4 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:25:10.252593 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-45bb4bb1-bcf9-4696-a15a-3b2774d29ab4 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:25:10.253351 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-45bb4bb1-bcf9-4696-a15a-3b2774d29ab4 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:25:10.253786 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-45bb4bb1-bcf9-4696-a15a-3b2774d29ab4 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:25:10.279629 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-45bb4bb1-bcf9-4696-a15a-3b2774d29ab4 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8] Going to try to terminate instance {{(pid=117799) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:25:10.360422 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-45bb4bb1-bcf9-4696-a15a-3b2774d29ab4 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "DELETE /compute/v2.1/servers/3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8" status: 204 len: 0 microversion: 2.1 time: 0.123059 May 26 15:25:10.361239 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 606/1185] 10.222.0.45 () {58 vars in 1238 bytes} [Thu May 26 15:25:10 2022] DELETE /compute/v2.1/servers/3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:25:10.371411 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-9444f712-9834-46ed-b5b4-38a85a6fe715 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:25:10.372116 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-9444f712-9834-46ed-b5b4-38a85a6fe715 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:25:10.378522 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9444f712-9834-46ed-b5b4-38a85a6fe715 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:25:10.379004 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9444f712-9834-46ed-b5b4-38a85a6fe715 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:25:10.379878 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9444f712-9834-46ed-b5b4-38a85a6fe715 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:25:10.380351 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9444f712-9834-46ed-b5b4-38a85a6fe715 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:25:10.515769 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-9444f712-9834-46ed-b5b4-38a85a6fe715 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:25:10.523679 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-9444f712-9834-46ed-b5b4-38a85a6fe715 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8" status: 200 len: 1513 microversion: 2.1 time: 0.157243 May 26 15:25:10.524857 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 580/1186] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:25:10 2022] GET /compute/v2.1/servers/3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:25:11.542885 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-466b4fda-9229-46eb-b09e-5735b11cd72d tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:25:11.543629 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-466b4fda-9229-46eb-b09e-5735b11cd72d tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:25:11.550048 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-466b4fda-9229-46eb-b09e-5735b11cd72d tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:25:11.550498 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-466b4fda-9229-46eb-b09e-5735b11cd72d tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:25:11.551291 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-466b4fda-9229-46eb-b09e-5735b11cd72d tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:25:11.551732 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-466b4fda-9229-46eb-b09e-5735b11cd72d tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:25:11.681726 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-466b4fda-9229-46eb-b09e-5735b11cd72d tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:25:11.689179 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-466b4fda-9229-46eb-b09e-5735b11cd72d tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8" status: 200 len: 1513 microversion: 2.1 time: 0.151272 May 26 15:25:11.689740 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 607/1187] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:25:11 2022] GET /compute/v2.1/servers/3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:25:12.706312 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-439a50c5-8b8b-4832-bcf7-fb15d3ecdf26 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:25:12.706906 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-439a50c5-8b8b-4832-bcf7-fb15d3ecdf26 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:25:12.713586 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-439a50c5-8b8b-4832-bcf7-fb15d3ecdf26 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:25:12.714038 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-439a50c5-8b8b-4832-bcf7-fb15d3ecdf26 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:25:12.714799 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-439a50c5-8b8b-4832-bcf7-fb15d3ecdf26 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:25:12.715273 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-439a50c5-8b8b-4832-bcf7-fb15d3ecdf26 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:25:12.845205 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-439a50c5-8b8b-4832-bcf7-fb15d3ecdf26 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:25:12.852565 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-439a50c5-8b8b-4832-bcf7-fb15d3ecdf26 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8" status: 200 len: 1513 microversion: 2.1 time: 0.150176 May 26 15:25:12.853125 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 581/1188] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:25:12 2022] GET /compute/v2.1/servers/3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:25:13.358553 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-5f5dd24c-ee3b-4cb0-9f22-dcdde4bcaea8 req-3de250e9-e9a1-4240-8b4a-c8376c351675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8", "name": "network-vif-deleted", "tag": "39b3f582-97a3-4adb-9564-f7b1e24fceb2"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:25:13.367110 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-5f5dd24c-ee3b-4cb0-9f22-dcdde4bcaea8 req-3de250e9-e9a1-4240-8b4a-c8376c351675 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:25:13.367566 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-5f5dd24c-ee3b-4cb0-9f22-dcdde4bcaea8 req-3de250e9-e9a1-4240-8b4a-c8376c351675 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:25:13.378740 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-5f5dd24c-ee3b-4cb0-9f22-dcdde4bcaea8 req-3de250e9-e9a1-4240-8b4a-c8376c351675 service nova] Creating event network-vif-deleted:39b3f582-97a3-4adb-9564-f7b1e24fceb2 for instance 3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8 on hv-cinder-84301 May 26 15:25:13.384934 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-5f5dd24c-ee3b-4cb0-9f22-dcdde4bcaea8 req-3de250e9-e9a1-4240-8b4a-c8376c351675 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029971 May 26 15:25:13.385543 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 608/1189] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:25:13.870944 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-a436b77a-d256-46b9-8bc0-4631d5c2e317 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:25:13.871563 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-a436b77a-d256-46b9-8bc0-4631d5c2e317 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:25:13.878288 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a436b77a-d256-46b9-8bc0-4631d5c2e317 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:25:13.878742 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a436b77a-d256-46b9-8bc0-4631d5c2e317 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:25:13.879539 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a436b77a-d256-46b9-8bc0-4631d5c2e317 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:25:13.879977 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a436b77a-d256-46b9-8bc0-4631d5c2e317 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:25:13.913265 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a436b77a-d256-46b9-8bc0-4631d5c2e317 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:25:13.914436 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-a436b77a-d256-46b9-8bc0-4631d5c2e317 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:25:13.914436 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.objects.instance [None req-a436b77a-d256-46b9-8bc0-4631d5c2e317 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lazy-loading 'fault' on Instance uuid 3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8 {{(pid=117798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:25:13.964327 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-a436b77a-d256-46b9-8bc0-4631d5c2e317 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65439e25dc88400dac2c457aa5ed139e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef506c64b2d442d299e2eb16910be975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:25:13.971236 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-a436b77a-d256-46b9-8bc0-4631d5c2e317 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8" status: 200 len: 1309 microversion: 2.1 time: 0.105437 May 26 15:25:13.971806 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 582/1190] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:25:13 2022] GET /compute/v2.1/servers/3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8 => generated 1309 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:25:14.990038 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-ab5beb4e-c25f-4d6b-8676-33f89fa860d3 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:25:14.990769 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-ab5beb4e-c25f-4d6b-8676-33f89fa860d3 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] [instance: 3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:25:14.997714 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ab5beb4e-c25f-4d6b-8676-33f89fa860d3 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:25:14.998162 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ab5beb4e-c25f-4d6b-8676-33f89fa860d3 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:25:14.998921 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ab5beb4e-c25f-4d6b-8676-33f89fa860d3 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:25:14.999389 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-ab5beb4e-c25f-4d6b-8676-33f89fa860d3 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:25:15.013621 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.wsgi [None req-ab5beb4e-c25f-4d6b-8676-33f89fa860d3 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] HTTP exception thrown: Instance 3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8 could not be found. May 26 15:25:15.015472 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-ab5beb4e-c25f-4d6b-8676-33f89fa860d3 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Request method failure captured: May 26 15:25:15.015472 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: request: GET /compute/v2.1/servers/3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8 HTTP/1.1 May 26 15:25:15.015472 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept: application/json May 26 15:25:15.015472 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept-Encoding: identity May 26 15:25:15.015472 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Connection: close May 26 15:25:15.015472 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Length: 0 May 26 15:25:15.015472 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Type: application/json May 26 15:25:15.015472 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Host: 10.222.0.45 May 26 15:25:15.015472 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Openstack-System-Scope: None May 26 15:25:15.015472 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: User-Agent: python-urllib3/1.26.9 May 26 15:25:15.015472 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Auth-Token: gAAAAABij5s_bchwII1VIPrM8Lokb8BFRmphzRhWZY1oJqoa9Ht-uWopJXbN8UVOT8G-mitP7a5IKoRZS6Xskn8uSPCkC2aKPTeHdc8mzzlgvg3AlFj4Mm2l12lxBpXOzVthRfsKJEtbH_ztbvezTmky4pgvxWN-jfcIvb9RPnRCKp7rvQFxCmw May 26 15:25:15.015472 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Id: None May 26 15:25:15.015472 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Name: None May 26 15:25:15.015472 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Identity-Status: Confirmed May 26 15:25:15.015472 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Is-Admin-Project: True May 26 15:25:15.015472 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Id: default May 26 15:25:15.015472 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Name: Default May 26 15:25:15.015472 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Id: ef506c64b2d442d299e2eb16910be975 May 26 15:25:15.015472 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Name: tempest-VolumesSnapshotTestJSON-564496835 May 26 15:25:15.015472 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Role: reader,member May 26 15:25:15.015472 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Roles: reader,member May 26 15:25:15.017233 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ef506c64b2d442d299e2eb16910be975"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ef506c64b2d442d299e2eb16910be975"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ef506c64b2d442d299e2eb16910be975"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ef506c64b2d442d299e2eb16910be975"}]}] May 26 15:25:15.017233 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant: tempest-VolumesSnapshotTestJSON-564496835 May 26 15:25:15.017233 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Id: ef506c64b2d442d299e2eb16910be975 May 26 15:25:15.017233 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-564496835 May 26 15:25:15.017233 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User: tempest-VolumesSnapshotTestJSON-564496835-project May 26 15:25:15.017233 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Id: default May 26 15:25:15.017233 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Name: Default May 26 15:25:15.017233 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Id: 65439e25dc88400dac2c457aa5ed139e May 26 15:25:15.017233 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Name: tempest-VolumesSnapshotTestJSON-564496835-project May 26 15:25:15.017233 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: method: > May 26 15:25:15.017233 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: exception: Instance 3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8 could not be found. May 26 15:25:15.017233 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: action_args: {'id': '3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8'} May 26 15:25:15.018234 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:25:15.018234 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:25:15.018234 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:25:15.018234 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:25:15.018234 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:25:15.018234 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:25:15.018234 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:25:15.018234 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:25:15.018234 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:25:15.018234 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:25:15.018234 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8 could not be found. May 26 15:25:15.018234 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:25:15.018234 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:25:15.018234 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:25:15.018234 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:25:15.018234 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:25:15.018234 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:25:15.018234 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:25:15.018234 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:25:15.018234 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:25:15.019689 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:25:15.019689 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:25:15.019689 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:25:15.019689 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:25:15.019689 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:25:15.019689 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:25:15.019689 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:25:15.019689 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8 could not be found. May 26 15:25:15.019689 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:25:15.019689 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:25:15.019689 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:25:15.019689 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:25:15.019689 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:25:15.019689 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:25:15.019689 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:25:15.019689 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:25:15.019689 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8 could not be found. May 26 15:25:15.019689 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:25:15.020942 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-ab5beb4e-c25f-4d6b-8676-33f89fa860d3 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] Returning 404 to user: Instance 3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8 could not be found. {{(pid=117799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:25:15.020942 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-ab5beb4e-c25f-4d6b-8676-33f89fa860d3 tempest-VolumesSnapshotTestJSON-564496835 tempest-VolumesSnapshotTestJSON-564496835-project] 10.222.0.45 "GET /compute/v2.1/servers/3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8" status: 404 len: 111 microversion: 2.1 time: 0.031597 May 26 15:25:15.020942 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 609/1191] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:25:14 2022] GET /compute/v2.1/servers/3abf7c5d-d6df-4ae3-a6f6-af990e38f8a8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:25:37.903831 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:25:37.904503 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Thu May 26 15:25:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 15:25:55.183752 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-75c1ce9e-0196-4fa9-be28-6b52ffd19c84 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:25:55.184783 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-75c1ce9e-0196-4fa9-be28-6b52ffd19c84 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:25:55.187036 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=10 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:25:55.187758 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:25:55.193606 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-75c1ce9e-0196-4fa9-be28-6b52ffd19c84 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:25:55.194285 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-75c1ce9e-0196-4fa9-be28-6b52ffd19c84 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:25:55.195112 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-75c1ce9e-0196-4fa9-be28-6b52ffd19c84 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:25:55.195552 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-75c1ce9e-0196-4fa9-be28-6b52ffd19c84 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:25:55.268701 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-75c1ce9e-0196-4fa9-be28-6b52ffd19c84 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "POST /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae/action" status: 202 len: 0 microversion: 2.1 time: 0.089983 May 26 15:25:55.271800 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 583/1192] 10.222.0.45 () {60 vars in 1277 bytes} [Thu May 26 15:25:55 2022] POST /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:25:55.277899 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-32ce54d0-bfeb-4b96-8efe-426602b9f55f tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:25:55.278689 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-32ce54d0-bfeb-4b96-8efe-426602b9f55f tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:25:55.280774 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:25:55.281412 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:25:55.288992 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-32ce54d0-bfeb-4b96-8efe-426602b9f55f tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:25:55.289461 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-32ce54d0-bfeb-4b96-8efe-426602b9f55f tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:25:55.290230 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-32ce54d0-bfeb-4b96-8efe-426602b9f55f tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:25:55.290656 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-32ce54d0-bfeb-4b96-8efe-426602b9f55f tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:25:55.442632 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-32ce54d0-bfeb-4b96-8efe-426602b9f55f tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:25:55.451161 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-32ce54d0-bfeb-4b96-8efe-426602b9f55f tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1750 microversion: 2.1 time: 0.177253 May 26 15:25:55.451743 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 610/1193] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:25:55 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1750 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:25:56.469432 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-082a9130-c6a7-4a44-8d0f-92831634ae04 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:25:56.470118 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-082a9130-c6a7-4a44-8d0f-92831634ae04 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:25:56.477638 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-082a9130-c6a7-4a44-8d0f-92831634ae04 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:25:56.478075 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-082a9130-c6a7-4a44-8d0f-92831634ae04 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:25:56.478832 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-082a9130-c6a7-4a44-8d0f-92831634ae04 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:25:56.479283 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-082a9130-c6a7-4a44-8d0f-92831634ae04 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:25:56.625372 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-082a9130-c6a7-4a44-8d0f-92831634ae04 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:25:56.633681 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-082a9130-c6a7-4a44-8d0f-92831634ae04 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1755 microversion: 2.1 time: 0.168529 May 26 15:25:56.634235 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 584/1194] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:25:56 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:25:57.652911 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-a5d5e7d0-0e4b-4d00-b1a7-59511441afa6 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:25:57.653523 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-a5d5e7d0-0e4b-4d00-b1a7-59511441afa6 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:25:57.659742 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a5d5e7d0-0e4b-4d00-b1a7-59511441afa6 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:25:57.660194 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a5d5e7d0-0e4b-4d00-b1a7-59511441afa6 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:25:57.660950 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a5d5e7d0-0e4b-4d00-b1a7-59511441afa6 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:25:57.661382 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-a5d5e7d0-0e4b-4d00-b1a7-59511441afa6 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:25:57.802233 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-a5d5e7d0-0e4b-4d00-b1a7-59511441afa6 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:25:57.811039 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-a5d5e7d0-0e4b-4d00-b1a7-59511441afa6 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1755 microversion: 2.1 time: 0.163357 May 26 15:25:57.811644 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 611/1195] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:25:57 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:25:58.829562 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-f2f6d3e3-183d-4eaf-87b8-f49ef695ea88 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:25:58.830201 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-f2f6d3e3-183d-4eaf-87b8-f49ef695ea88 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:25:58.836949 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f2f6d3e3-183d-4eaf-87b8-f49ef695ea88 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:25:58.837389 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f2f6d3e3-183d-4eaf-87b8-f49ef695ea88 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:25:58.838144 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f2f6d3e3-183d-4eaf-87b8-f49ef695ea88 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:25:58.838573 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-f2f6d3e3-183d-4eaf-87b8-f49ef695ea88 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:25:58.979037 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-f2f6d3e3-183d-4eaf-87b8-f49ef695ea88 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:25:58.987194 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-f2f6d3e3-183d-4eaf-87b8-f49ef695ea88 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1755 microversion: 2.1 time: 0.161446 May 26 15:25:58.987826 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 585/1196] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:25:58 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:26:00.006226 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-842660e0-7ae5-4af2-af52-12a886d63af9 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:26:00.006979 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-842660e0-7ae5-4af2-af52-12a886d63af9 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:26:00.013781 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-842660e0-7ae5-4af2-af52-12a886d63af9 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:00.014231 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-842660e0-7ae5-4af2-af52-12a886d63af9 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:00.014998 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-842660e0-7ae5-4af2-af52-12a886d63af9 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:00.015460 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-842660e0-7ae5-4af2-af52-12a886d63af9 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:00.161337 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-842660e0-7ae5-4af2-af52-12a886d63af9 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:26:00.170340 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-842660e0-7ae5-4af2-af52-12a886d63af9 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1755 microversion: 2.1 time: 0.168098 May 26 15:26:00.170970 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 612/1197] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:26:00 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:26:01.187653 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-0f82ece5-ec92-446e-bb1f-c648a6f9b887 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:26:01.188265 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-0f82ece5-ec92-446e-bb1f-c648a6f9b887 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:26:01.195312 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0f82ece5-ec92-446e-bb1f-c648a6f9b887 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:01.195767 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0f82ece5-ec92-446e-bb1f-c648a6f9b887 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:01.196526 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0f82ece5-ec92-446e-bb1f-c648a6f9b887 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:01.196960 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0f82ece5-ec92-446e-bb1f-c648a6f9b887 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:01.339346 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-0f82ece5-ec92-446e-bb1f-c648a6f9b887 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:26:01.347522 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-0f82ece5-ec92-446e-bb1f-c648a6f9b887 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1755 microversion: 2.1 time: 0.163689 May 26 15:26:01.348094 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 586/1198] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:26:01 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:26:02.364923 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-e1d69315-89c9-47b7-b974-299b246c8786 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:26:02.366465 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-e1d69315-89c9-47b7-b974-299b246c8786 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:26:02.373003 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e1d69315-89c9-47b7-b974-299b246c8786 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:02.373451 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e1d69315-89c9-47b7-b974-299b246c8786 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:02.374288 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e1d69315-89c9-47b7-b974-299b246c8786 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:02.374807 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-e1d69315-89c9-47b7-b974-299b246c8786 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:02.519485 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-e1d69315-89c9-47b7-b974-299b246c8786 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:26:02.528155 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-e1d69315-89c9-47b7-b974-299b246c8786 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1755 microversion: 2.1 time: 0.167179 May 26 15:26:02.528727 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 613/1199] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:26:02 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:26:03.545651 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-1f84309d-4199-4c3a-bde7-eb35ba30a6d8 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:26:03.546267 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-1f84309d-4199-4c3a-bde7-eb35ba30a6d8 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:26:03.552718 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1f84309d-4199-4c3a-bde7-eb35ba30a6d8 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:03.553764 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1f84309d-4199-4c3a-bde7-eb35ba30a6d8 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:03.554602 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1f84309d-4199-4c3a-bde7-eb35ba30a6d8 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:03.555034 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-1f84309d-4199-4c3a-bde7-eb35ba30a6d8 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:03.694784 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-1f84309d-4199-4c3a-bde7-eb35ba30a6d8 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:26:03.702691 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-1f84309d-4199-4c3a-bde7-eb35ba30a6d8 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1755 microversion: 2.1 time: 0.160953 May 26 15:26:03.703294 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 587/1200] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:26:03 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:26:04.721231 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-dd69e8d0-7948-4e2c-89b3-ec3dd282e4c0 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:26:04.721942 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-dd69e8d0-7948-4e2c-89b3-ec3dd282e4c0 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:26:04.729555 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dd69e8d0-7948-4e2c-89b3-ec3dd282e4c0 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:04.730009 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dd69e8d0-7948-4e2c-89b3-ec3dd282e4c0 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:04.730794 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dd69e8d0-7948-4e2c-89b3-ec3dd282e4c0 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:04.731268 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dd69e8d0-7948-4e2c-89b3-ec3dd282e4c0 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:04.876525 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-dd69e8d0-7948-4e2c-89b3-ec3dd282e4c0 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:26:04.885039 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-dd69e8d0-7948-4e2c-89b3-ec3dd282e4c0 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1755 microversion: 2.1 time: 0.167977 May 26 15:26:04.885604 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 614/1201] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:26:04 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:26:05.902587 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-4af5599d-4e22-441b-bc3b-03eae61fd29d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:26:05.903224 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-4af5599d-4e22-441b-bc3b-03eae61fd29d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:26:05.909750 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4af5599d-4e22-441b-bc3b-03eae61fd29d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:05.910195 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4af5599d-4e22-441b-bc3b-03eae61fd29d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:05.910949 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4af5599d-4e22-441b-bc3b-03eae61fd29d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:05.911412 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-4af5599d-4e22-441b-bc3b-03eae61fd29d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:06.058061 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-4af5599d-4e22-441b-bc3b-03eae61fd29d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:26:06.066032 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-4af5599d-4e22-441b-bc3b-03eae61fd29d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1755 microversion: 2.1 time: 0.167316 May 26 15:26:06.066606 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 588/1202] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:26:05 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:26:07.084224 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-deac1bf1-e681-462e-8a11-9d861b9dc8f9 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:26:07.085531 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-deac1bf1-e681-462e-8a11-9d861b9dc8f9 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:26:07.092007 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-deac1bf1-e681-462e-8a11-9d861b9dc8f9 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:07.092459 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-deac1bf1-e681-462e-8a11-9d861b9dc8f9 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:07.093220 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-deac1bf1-e681-462e-8a11-9d861b9dc8f9 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:07.093655 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-deac1bf1-e681-462e-8a11-9d861b9dc8f9 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:07.237163 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-deac1bf1-e681-462e-8a11-9d861b9dc8f9 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:26:07.245554 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-deac1bf1-e681-462e-8a11-9d861b9dc8f9 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1755 microversion: 2.1 time: 0.165677 May 26 15:26:07.246110 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 615/1203] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:26:07 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:26:08.262796 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-98d297ba-9f47-4848-a3a5-c191acead501 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:26:08.263415 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-98d297ba-9f47-4848-a3a5-c191acead501 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:26:08.269997 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-98d297ba-9f47-4848-a3a5-c191acead501 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:08.270447 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-98d297ba-9f47-4848-a3a5-c191acead501 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:08.271241 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-98d297ba-9f47-4848-a3a5-c191acead501 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:08.272227 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-98d297ba-9f47-4848-a3a5-c191acead501 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:08.416438 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-98d297ba-9f47-4848-a3a5-c191acead501 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:26:08.424326 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-98d297ba-9f47-4848-a3a5-c191acead501 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1755 microversion: 2.1 time: 0.165619 May 26 15:26:08.424897 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 589/1204] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:26:08 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:26:09.441698 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-f58f0609-b917-483a-ad23-331c714ce860 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:26:09.442311 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-f58f0609-b917-483a-ad23-331c714ce860 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:26:09.448922 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f58f0609-b917-483a-ad23-331c714ce860 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:09.449368 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f58f0609-b917-483a-ad23-331c714ce860 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:09.450127 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f58f0609-b917-483a-ad23-331c714ce860 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:09.450562 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f58f0609-b917-483a-ad23-331c714ce860 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:09.593698 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-f58f0609-b917-483a-ad23-331c714ce860 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:26:09.602810 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-f58f0609-b917-483a-ad23-331c714ce860 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1755 microversion: 2.1 time: 0.165024 May 26 15:26:09.603410 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 616/1205] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:26:09 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:26:10.620617 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-da5695c6-613c-4d98-9c50-d2d3d785bbae tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:26:10.621219 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-da5695c6-613c-4d98-9c50-d2d3d785bbae tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:26:10.627471 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-da5695c6-613c-4d98-9c50-d2d3d785bbae tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:10.627915 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-da5695c6-613c-4d98-9c50-d2d3d785bbae tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:10.628668 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-da5695c6-613c-4d98-9c50-d2d3d785bbae tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:10.629097 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-da5695c6-613c-4d98-9c50-d2d3d785bbae tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:10.772805 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-da5695c6-613c-4d98-9c50-d2d3d785bbae tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:26:10.780771 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-da5695c6-613c-4d98-9c50-d2d3d785bbae tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1755 microversion: 2.1 time: 0.164175 May 26 15:26:10.781390 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 590/1206] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:26:10 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:26:11.797812 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-9b089d37-e9d3-4c7f-88f9-502af4c0607d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:26:11.798442 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-9b089d37-e9d3-4c7f-88f9-502af4c0607d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:26:11.805707 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9b089d37-e9d3-4c7f-88f9-502af4c0607d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:11.806159 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9b089d37-e9d3-4c7f-88f9-502af4c0607d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:11.806962 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9b089d37-e9d3-4c7f-88f9-502af4c0607d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:11.807427 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-9b089d37-e9d3-4c7f-88f9-502af4c0607d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:11.948821 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-9b089d37-e9d3-4c7f-88f9-502af4c0607d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:26:11.956886 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-9b089d37-e9d3-4c7f-88f9-502af4c0607d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1758 microversion: 2.1 time: 0.163020 May 26 15:26:11.957450 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 617/1207] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:26:11 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:26:44.214134 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-b8ffdcf2-dc07-48ff-99f5-40695efadcb5 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:26:44.214738 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b8ffdcf2-dc07-48ff-99f5-40695efadcb5 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 5d1d8945-5896-4ef2-9033-3b091083a15b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:26:44.215657 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-bfccb867-5da0-4abb-9788-2683a1356f14 req-90430750-3a75-4559-bb05-3b77297c46ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d1d8945-5896-4ef2-9033-3b091083a15b", "tag": "2edf9591-6b8d-40a5-bf70-1046a458a5d4"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:26:44.218076 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=16 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:26:44.218668 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:26:44.222886 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b8ffdcf2-dc07-48ff-99f5-40695efadcb5 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:44.223074 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_api:SELECT=16 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:26:44.223472 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b8ffdcf2-dc07-48ff-99f5-40695efadcb5 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:44.223863 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=48 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:26:44.224824 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b8ffdcf2-dc07-48ff-99f5-40695efadcb5 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:44.225246 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-b8ffdcf2-dc07-48ff-99f5-40695efadcb5 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:44.226390 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-bfccb867-5da0-4abb-9788-2683a1356f14 req-90430750-3a75-4559-bb05-3b77297c46ea service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:44.226952 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-bfccb867-5da0-4abb-9788-2683a1356f14 req-90430750-3a75-4559-bb05-3b77297c46ea service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:44.241864 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-bfccb867-5da0-4abb-9788-2683a1356f14 req-90430750-3a75-4559-bb05-3b77297c46ea service nova] Creating event network-changed:2edf9591-6b8d-40a5-bf70-1046a458a5d4 for instance 5d1d8945-5896-4ef2-9033-3b091083a15b on hv-cinder-84301 May 26 15:26:44.247378 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-bfccb867-5da0-4abb-9788-2683a1356f14 req-90430750-3a75-4559-bb05-3b77297c46ea service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035226 May 26 15:26:44.248213 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 618/1208] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:26:44.254814 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-b8ffdcf2-dc07-48ff-99f5-40695efadcb5 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 5d1d8945-5896-4ef2-9033-3b091083a15b] Going to try to terminate instance {{(pid=117798) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:26:44.343927 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-b8ffdcf2-dc07-48ff-99f5-40695efadcb5 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "DELETE /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b" status: 204 len: 0 microversion: 2.1 time: 0.133751 May 26 15:26:44.348214 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 591/1209] 10.222.0.45 () {58 vars in 1238 bytes} [Thu May 26 15:26:44 2022] DELETE /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 15:26:44.357448 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-6cbf2c3d-9564-4fdd-9d49-d0e9240b81b1 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:26:44.358287 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-6cbf2c3d-9564-4fdd-9d49-d0e9240b81b1 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 5d1d8945-5896-4ef2-9033-3b091083a15b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:26:44.365139 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6cbf2c3d-9564-4fdd-9d49-d0e9240b81b1 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:44.365896 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6cbf2c3d-9564-4fdd-9d49-d0e9240b81b1 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:44.366751 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6cbf2c3d-9564-4fdd-9d49-d0e9240b81b1 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:44.367284 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-6cbf2c3d-9564-4fdd-9d49-d0e9240b81b1 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:44.513793 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-6cbf2c3d-9564-4fdd-9d49-d0e9240b81b1 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:26:44.522834 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-6cbf2c3d-9564-4fdd-9d49-d0e9240b81b1 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b" status: 200 len: 1576 microversion: 2.1 time: 0.169953 May 26 15:26:44.523455 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 619/1210] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:26:44 2022] GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:26:45.541413 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-01e8077e-d01c-4ef2-80d8-fd79827d7b34 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:26:45.542030 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-01e8077e-d01c-4ef2-80d8-fd79827d7b34 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 5d1d8945-5896-4ef2-9033-3b091083a15b] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:26:45.548697 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-01e8077e-d01c-4ef2-80d8-fd79827d7b34 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:45.549139 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-01e8077e-d01c-4ef2-80d8-fd79827d7b34 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:45.549907 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-01e8077e-d01c-4ef2-80d8-fd79827d7b34 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:45.550336 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-01e8077e-d01c-4ef2-80d8-fd79827d7b34 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:45.687144 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-01e8077e-d01c-4ef2-80d8-fd79827d7b34 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:26:45.695736 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-01e8077e-d01c-4ef2-80d8-fd79827d7b34 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b" status: 200 len: 1576 microversion: 2.1 time: 0.159212 May 26 15:26:45.696301 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 592/1211] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:26:45 2022] GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:26:46.713203 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-c41bb0ab-16fe-4446-b626-2199000ecca4 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:26:46.713927 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-c41bb0ab-16fe-4446-b626-2199000ecca4 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 5d1d8945-5896-4ef2-9033-3b091083a15b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:26:46.720573 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c41bb0ab-16fe-4446-b626-2199000ecca4 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:46.721113 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c41bb0ab-16fe-4446-b626-2199000ecca4 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:46.721974 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c41bb0ab-16fe-4446-b626-2199000ecca4 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:46.722487 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-c41bb0ab-16fe-4446-b626-2199000ecca4 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:46.789590 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-c41bb0ab-16fe-4446-b626-2199000ecca4 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:26:46.797463 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-c41bb0ab-16fe-4446-b626-2199000ecca4 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b" status: 200 len: 1391 microversion: 2.1 time: 0.088156 May 26 15:26:46.799830 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 620/1212] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:26:46 2022] GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b => generated 1391 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:26:46.992273 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-627e41ce-b9ec-4c88-8b7d-10cfe2d0fb43 req-3ba8a291-5017-4794-8c1c-d5c73ebeea62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d1d8945-5896-4ef2-9033-3b091083a15b", "name": "network-vif-deleted", "tag": "2edf9591-6b8d-40a5-bf70-1046a458a5d4"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:26:47.000333 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-627e41ce-b9ec-4c88-8b7d-10cfe2d0fb43 req-3ba8a291-5017-4794-8c1c-d5c73ebeea62 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:47.000776 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-627e41ce-b9ec-4c88-8b7d-10cfe2d0fb43 req-3ba8a291-5017-4794-8c1c-d5c73ebeea62 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:47.011378 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-627e41ce-b9ec-4c88-8b7d-10cfe2d0fb43 req-3ba8a291-5017-4794-8c1c-d5c73ebeea62 service nova] Creating event network-vif-deleted:2edf9591-6b8d-40a5-bf70-1046a458a5d4 for instance 5d1d8945-5896-4ef2-9033-3b091083a15b on hv-cinder-84301 May 26 15:26:47.016475 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-627e41ce-b9ec-4c88-8b7d-10cfe2d0fb43 req-3ba8a291-5017-4794-8c1c-d5c73ebeea62 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.224471 May 26 15:26:47.017062 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 593/1213] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:26:47.814596 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-859f18f5-01a0-4c76-a50e-d4205266e8da tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:26:47.815283 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-859f18f5-01a0-4c76-a50e-d4205266e8da tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 5d1d8945-5896-4ef2-9033-3b091083a15b] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:26:47.822164 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-859f18f5-01a0-4c76-a50e-d4205266e8da tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:47.822624 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-859f18f5-01a0-4c76-a50e-d4205266e8da tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:47.823422 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-859f18f5-01a0-4c76-a50e-d4205266e8da tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:47.823862 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-859f18f5-01a0-4c76-a50e-d4205266e8da tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:47.838171 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.wsgi [None req-859f18f5-01a0-4c76-a50e-d4205266e8da tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] HTTP exception thrown: Instance 5d1d8945-5896-4ef2-9033-3b091083a15b could not be found. May 26 15:26:47.839823 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-859f18f5-01a0-4c76-a50e-d4205266e8da tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Request method failure captured: May 26 15:26:47.839823 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: request: GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b HTTP/1.1 May 26 15:26:47.839823 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept: application/json May 26 15:26:47.839823 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept-Encoding: identity May 26 15:26:47.839823 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Connection: close May 26 15:26:47.839823 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Length: 0 May 26 15:26:47.839823 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Type: application/json May 26 15:26:47.839823 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Host: 10.222.0.45 May 26 15:26:47.839823 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Openstack-System-Scope: None May 26 15:26:47.839823 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: User-Agent: python-urllib3/1.26.9 May 26 15:26:47.839823 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Auth-Token: gAAAAABij5nexOfvx9HOyJdMFv0iYw26G55P0mcIJ964qVRlBpnl5dDkcp5teDBUHs1fAiDyrF3SCEhLZfW8wetD5OqfpnRwTYGwKNFfkkYJ5jLmXcaV-DxhyVIa0__cD3b3mLD86YOWSidiK3Rp0MY0Do-Ig3pSvtmTqKtdOWnzn_eFIrSO7Dw May 26 15:26:47.839823 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Id: None May 26 15:26:47.839823 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Name: None May 26 15:26:47.839823 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Identity-Status: Confirmed May 26 15:26:47.839823 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Is-Admin-Project: True May 26 15:26:47.839823 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Id: default May 26 15:26:47.839823 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Name: Default May 26 15:26:47.839823 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Id: 1da6b127a0d64f8892c4935ef08ed679 May 26 15:26:47.839823 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Name: tempest-TestVolumeBootPattern-1530978248 May 26 15:26:47.839823 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Role: reader,member May 26 15:26:47.839823 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Roles: reader,member May 26 15:26:47.841571 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1da6b127a0d64f8892c4935ef08ed679"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1da6b127a0d64f8892c4935ef08ed679"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1da6b127a0d64f8892c4935ef08ed679"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1da6b127a0d64f8892c4935ef08ed679"}]}] May 26 15:26:47.841571 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant: tempest-TestVolumeBootPattern-1530978248 May 26 15:26:47.841571 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Id: 1da6b127a0d64f8892c4935ef08ed679 May 26 15:26:47.841571 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Name: tempest-TestVolumeBootPattern-1530978248 May 26 15:26:47.841571 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User: tempest-TestVolumeBootPattern-1530978248-project May 26 15:26:47.841571 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Id: default May 26 15:26:47.841571 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Name: Default May 26 15:26:47.841571 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Id: e55884035fd3441583ece37dd8eb9248 May 26 15:26:47.841571 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Name: tempest-TestVolumeBootPattern-1530978248-project May 26 15:26:47.841571 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: method: > May 26 15:26:47.841571 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: exception: Instance 5d1d8945-5896-4ef2-9033-3b091083a15b could not be found. May 26 15:26:47.841571 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: action_args: {'id': '5d1d8945-5896-4ef2-9033-3b091083a15b'} May 26 15:26:47.842733 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:26:47.842733 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:26:47.842733 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:26:47.842733 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:26:47.842733 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:26:47.842733 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:26:47.842733 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:26:47.842733 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:26:47.842733 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:26:47.842733 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:26:47.842733 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d1d8945-5896-4ef2-9033-3b091083a15b could not be found. May 26 15:26:47.842733 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:26:47.842733 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:26:47.842733 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:26:47.842733 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:26:47.842733 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:26:47.842733 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:26:47.842733 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:26:47.842733 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:26:47.842733 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:26:47.844421 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:26:47.844421 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:26:47.844421 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:26:47.844421 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:26:47.844421 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:26:47.844421 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:26:47.844421 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:26:47.844421 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d1d8945-5896-4ef2-9033-3b091083a15b could not be found. May 26 15:26:47.844421 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:26:47.844421 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:26:47.844421 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:26:47.844421 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:26:47.844421 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:26:47.844421 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:26:47.844421 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:26:47.844421 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:26:47.844421 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d1d8945-5896-4ef2-9033-3b091083a15b could not be found. May 26 15:26:47.844421 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:26:47.846058 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-859f18f5-01a0-4c76-a50e-d4205266e8da tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Returning 404 to user: Instance 5d1d8945-5896-4ef2-9033-3b091083a15b could not be found. {{(pid=117799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:26:47.846058 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-859f18f5-01a0-4c76-a50e-d4205266e8da tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b" status: 404 len: 111 microversion: 2.1 time: 0.030563 May 26 15:26:47.846058 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 621/1214] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:26:47 2022] GET /compute/v2.1/servers/5d1d8945-5896-4ef2-9033-3b091083a15b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:26:51.194271 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-2fd64503-2748-4c98-bbc1-25a6ca130c28 req-44c06017-b4d0-4230-a7db-6ba26a5a89be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "415bda6c-cdab-45fa-adfe-590484a01588", "tag": "034c4c8a-2f6d-4111-819f-f099fea94828"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:26:51.200606 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-9bd8a7b0-1b00-403c-83c1-38f01178efbb tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:26:51.201185 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-9bd8a7b0-1b00-403c-83c1-38f01178efbb tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 415bda6c-cdab-45fa-adfe-590484a01588] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:26:51.212486 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-2fd64503-2748-4c98-bbc1-25a6ca130c28 req-44c06017-b4d0-4230-a7db-6ba26a5a89be service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:51.212724 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9bd8a7b0-1b00-403c-83c1-38f01178efbb tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:51.212933 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-2fd64503-2748-4c98-bbc1-25a6ca130c28 req-44c06017-b4d0-4230-a7db-6ba26a5a89be service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:51.213286 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9bd8a7b0-1b00-403c-83c1-38f01178efbb tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:51.214058 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9bd8a7b0-1b00-403c-83c1-38f01178efbb tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:51.214489 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-9bd8a7b0-1b00-403c-83c1-38f01178efbb tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:51.225115 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-2fd64503-2748-4c98-bbc1-25a6ca130c28 req-44c06017-b4d0-4230-a7db-6ba26a5a89be service nova] Creating event network-changed:034c4c8a-2f6d-4111-819f-f099fea94828 for instance 415bda6c-cdab-45fa-adfe-590484a01588 on hv-cinder-84301 May 26 15:26:51.230261 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-2fd64503-2748-4c98-bbc1-25a6ca130c28 req-44c06017-b4d0-4230-a7db-6ba26a5a89be service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041043 May 26 15:26:51.231208 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 622/1215] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:26:51.243488 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-9bd8a7b0-1b00-403c-83c1-38f01178efbb tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 415bda6c-cdab-45fa-adfe-590484a01588] Going to try to terminate instance {{(pid=117798) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:26:51.331785 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-9bd8a7b0-1b00-403c-83c1-38f01178efbb tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "DELETE /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588" status: 204 len: 0 microversion: 2.1 time: 0.135449 May 26 15:26:51.332784 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 594/1216] 10.222.0.45 () {58 vars in 1238 bytes} [Thu May 26 15:26:51 2022] DELETE /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:26:51.344398 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-897f124d-3646-4c2d-a21f-616071c8476c tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:26:51.345110 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-897f124d-3646-4c2d-a21f-616071c8476c tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 415bda6c-cdab-45fa-adfe-590484a01588] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:26:51.361628 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-897f124d-3646-4c2d-a21f-616071c8476c tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:51.362079 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-897f124d-3646-4c2d-a21f-616071c8476c tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:51.362905 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-897f124d-3646-4c2d-a21f-616071c8476c tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:51.363372 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-897f124d-3646-4c2d-a21f-616071c8476c tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:51.504701 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-897f124d-3646-4c2d-a21f-616071c8476c tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:26:51.514114 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-897f124d-3646-4c2d-a21f-616071c8476c tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588" status: 200 len: 1577 microversion: 2.1 time: 0.174466 May 26 15:26:51.514979 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 623/1217] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:26:51 2022] GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588 => generated 1577 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:26:52.514572 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [req-76e7e7ec-9ef1-48b5-a0aa-b448b8b7418c req-f26360d0-44cf-4ff2-9955-088f91e674c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "415bda6c-cdab-45fa-adfe-590484a01588", "name": "network-vif-deleted", "tag": "034c4c8a-2f6d-4111-819f-f099fea94828"}]} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:26:52.525851 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-76e7e7ec-9ef1-48b5-a0aa-b448b8b7418c req-f26360d0-44cf-4ff2-9955-088f91e674c3 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:52.526292 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [req-76e7e7ec-9ef1-48b5-a0aa-b448b8b7418c req-f26360d0-44cf-4ff2-9955-088f91e674c3 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:52.532013 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-f420c09f-8b08-47dc-a5e8-64c3989a87a1 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:26:52.532910 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-f420c09f-8b08-47dc-a5e8-64c3989a87a1 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 415bda6c-cdab-45fa-adfe-590484a01588] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:26:52.540061 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.compute.server_external_events [req-76e7e7ec-9ef1-48b5-a0aa-b448b8b7418c req-f26360d0-44cf-4ff2-9955-088f91e674c3 service nova] Creating event network-vif-deleted:034c4c8a-2f6d-4111-819f-f099fea94828 for instance 415bda6c-cdab-45fa-adfe-590484a01588 on hv-cinder-84301 May 26 15:26:52.540272 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f420c09f-8b08-47dc-a5e8-64c3989a87a1 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:52.540595 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f420c09f-8b08-47dc-a5e8-64c3989a87a1 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:52.541602 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f420c09f-8b08-47dc-a5e8-64c3989a87a1 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:52.541950 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-f420c09f-8b08-47dc-a5e8-64c3989a87a1 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:52.545365 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [req-76e7e7ec-9ef1-48b5-a0aa-b448b8b7418c req-f26360d0-44cf-4ff2-9955-088f91e674c3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035064 May 26 15:26:52.545969 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 595/1218] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:26:52.617795 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-f420c09f-8b08-47dc-a5e8-64c3989a87a1 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e55884035fd3441583ece37dd8eb9248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da6b127a0d64f8892c4935ef08ed679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:26:52.625330 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-f420c09f-8b08-47dc-a5e8-64c3989a87a1 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588" status: 200 len: 1225 microversion: 2.1 time: 0.097650 May 26 15:26:52.626009 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 624/1219] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:26:52 2022] GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:26:53.642948 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-0aee4795-021a-49da-8ad7-57b8e94a93e1 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:26:53.643591 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-0aee4795-021a-49da-8ad7-57b8e94a93e1 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 415bda6c-cdab-45fa-adfe-590484a01588] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:26:53.651532 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0aee4795-021a-49da-8ad7-57b8e94a93e1 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:53.651972 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0aee4795-021a-49da-8ad7-57b8e94a93e1 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:53.652730 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0aee4795-021a-49da-8ad7-57b8e94a93e1 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:53.653165 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0aee4795-021a-49da-8ad7-57b8e94a93e1 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:53.668644 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-0aee4795-021a-49da-8ad7-57b8e94a93e1 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] HTTP exception thrown: Instance 415bda6c-cdab-45fa-adfe-590484a01588 could not be found. May 26 15:26:53.670235 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-0aee4795-021a-49da-8ad7-57b8e94a93e1 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Request method failure captured: May 26 15:26:53.670235 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: request: GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588 HTTP/1.1 May 26 15:26:53.670235 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept: application/json May 26 15:26:53.670235 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity May 26 15:26:53.670235 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Connection: close May 26 15:26:53.670235 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Length: 0 May 26 15:26:53.670235 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Type: application/json May 26 15:26:53.670235 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Host: 10.222.0.45 May 26 15:26:53.670235 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None May 26 15:26:53.670235 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 May 26 15:26:53.670235 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABij5nexOfvx9HOyJdMFv0iYw26G55P0mcIJ964qVRlBpnl5dDkcp5teDBUHs1fAiDyrF3SCEhLZfW8wetD5OqfpnRwTYGwKNFfkkYJ5jLmXcaV-DxhyVIa0__cD3b3mLD86YOWSidiK3Rp0MY0Do-Ig3pSvtmTqKtdOWnzn_eFIrSO7Dw May 26 15:26:53.670235 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Id: None May 26 15:26:53.670235 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Name: None May 26 15:26:53.670235 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed May 26 15:26:53.670235 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True May 26 15:26:53.670235 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default May 26 15:26:53.670235 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default May 26 15:26:53.670235 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Id: 1da6b127a0d64f8892c4935ef08ed679 May 26 15:26:53.670235 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-TestVolumeBootPattern-1530978248 May 26 15:26:53.670235 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Role: reader,member May 26 15:26:53.670235 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Roles: reader,member May 26 15:26:53.671912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1da6b127a0d64f8892c4935ef08ed679"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1da6b127a0d64f8892c4935ef08ed679"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1da6b127a0d64f8892c4935ef08ed679"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1da6b127a0d64f8892c4935ef08ed679"}]}] May 26 15:26:53.671912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-TestVolumeBootPattern-1530978248 May 26 15:26:53.671912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Id: 1da6b127a0d64f8892c4935ef08ed679 May 26 15:26:53.671912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-TestVolumeBootPattern-1530978248 May 26 15:26:53.671912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User: tempest-TestVolumeBootPattern-1530978248-project May 26 15:26:53.671912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default May 26 15:26:53.671912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default May 26 15:26:53.671912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Id: e55884035fd3441583ece37dd8eb9248 May 26 15:26:53.671912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-TestVolumeBootPattern-1530978248-project May 26 15:26:53.671912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: method: > May 26 15:26:53.671912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: exception: Instance 415bda6c-cdab-45fa-adfe-590484a01588 could not be found. May 26 15:26:53.671912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: action_args: {'id': '415bda6c-cdab-45fa-adfe-590484a01588'} May 26 15:26:53.672900 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:26:53.672900 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:26:53.672900 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:26:53.672900 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:26:53.672900 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:26:53.672900 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:26:53.672900 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:26:53.672900 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:26:53.672900 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:26:53.672900 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:26:53.672900 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 415bda6c-cdab-45fa-adfe-590484a01588 could not be found. May 26 15:26:53.672900 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:26:53.672900 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:26:53.672900 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:26:53.672900 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:26:53.672900 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:26:53.672900 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:26:53.672900 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:26:53.672900 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:26:53.672900 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:26:53.674600 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:26:53.674600 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:26:53.674600 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:26:53.674600 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:26:53.674600 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:26:53.674600 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:26:53.674600 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:26:53.674600 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 415bda6c-cdab-45fa-adfe-590484a01588 could not be found. May 26 15:26:53.674600 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:26:53.674600 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:26:53.674600 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:26:53.674600 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:26:53.674600 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:26:53.674600 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:26:53.674600 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:26:53.674600 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:26:53.674600 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 415bda6c-cdab-45fa-adfe-590484a01588 could not be found. May 26 15:26:53.674600 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:26:53.676266 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-0aee4795-021a-49da-8ad7-57b8e94a93e1 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Returning 404 to user: Instance 415bda6c-cdab-45fa-adfe-590484a01588 could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:26:53.676266 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-0aee4795-021a-49da-8ad7-57b8e94a93e1 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588" status: 404 len: 111 microversion: 2.1 time: 0.032957 May 26 15:26:53.676266 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 596/1220] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:26:53 2022] GET /compute/v2.1/servers/415bda6c-cdab-45fa-adfe-590484a01588 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:26:54.111955 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-45893dd5-0939-4289-85f1-6e64026b6227 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:26:54.112517 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-45893dd5-0939-4289-85f1-6e64026b6227 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 612ae9ec-d528-4264-afd3-373c904f50fd] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:26:54.120178 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-45893dd5-0939-4289-85f1-6e64026b6227 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:54.120629 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-45893dd5-0939-4289-85f1-6e64026b6227 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:54.121492 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-45893dd5-0939-4289-85f1-6e64026b6227 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:54.122014 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-45893dd5-0939-4289-85f1-6e64026b6227 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:54.136841 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.wsgi [None req-45893dd5-0939-4289-85f1-6e64026b6227 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] HTTP exception thrown: Instance 612ae9ec-d528-4264-afd3-373c904f50fd could not be found. May 26 15:26:54.138779 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-45893dd5-0939-4289-85f1-6e64026b6227 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Request method failure captured: May 26 15:26:54.138779 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: request: DELETE /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd HTTP/1.1 May 26 15:26:54.138779 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept: application/json May 26 15:26:54.138779 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept-Encoding: identity May 26 15:26:54.138779 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Connection: close May 26 15:26:54.138779 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Length: 0 May 26 15:26:54.138779 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Type: application/json May 26 15:26:54.138779 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Host: 10.222.0.45 May 26 15:26:54.138779 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Openstack-System-Scope: None May 26 15:26:54.138779 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: User-Agent: python-urllib3/1.26.9 May 26 15:26:54.138779 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Auth-Token: gAAAAABij5nexOfvx9HOyJdMFv0iYw26G55P0mcIJ964qVRlBpnl5dDkcp5teDBUHs1fAiDyrF3SCEhLZfW8wetD5OqfpnRwTYGwKNFfkkYJ5jLmXcaV-DxhyVIa0__cD3b3mLD86YOWSidiK3Rp0MY0Do-Ig3pSvtmTqKtdOWnzn_eFIrSO7Dw May 26 15:26:54.138779 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Id: None May 26 15:26:54.138779 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Name: None May 26 15:26:54.138779 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Identity-Status: Confirmed May 26 15:26:54.138779 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Is-Admin-Project: True May 26 15:26:54.138779 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Id: default May 26 15:26:54.138779 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Name: Default May 26 15:26:54.138779 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Id: 1da6b127a0d64f8892c4935ef08ed679 May 26 15:26:54.138779 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Name: tempest-TestVolumeBootPattern-1530978248 May 26 15:26:54.138779 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Role: reader,member May 26 15:26:54.138779 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Roles: reader,member May 26 15:26:54.140513 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1da6b127a0d64f8892c4935ef08ed679"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1da6b127a0d64f8892c4935ef08ed679"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1da6b127a0d64f8892c4935ef08ed679"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1da6b127a0d64f8892c4935ef08ed679"}]}] May 26 15:26:54.140513 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant: tempest-TestVolumeBootPattern-1530978248 May 26 15:26:54.140513 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Id: 1da6b127a0d64f8892c4935ef08ed679 May 26 15:26:54.140513 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Name: tempest-TestVolumeBootPattern-1530978248 May 26 15:26:54.140513 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User: tempest-TestVolumeBootPattern-1530978248-project May 26 15:26:54.140513 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Id: default May 26 15:26:54.140513 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Name: Default May 26 15:26:54.140513 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Id: e55884035fd3441583ece37dd8eb9248 May 26 15:26:54.140513 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Name: tempest-TestVolumeBootPattern-1530978248-project May 26 15:26:54.140513 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: method: > May 26 15:26:54.140513 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: exception: Instance 612ae9ec-d528-4264-afd3-373c904f50fd could not be found. May 26 15:26:54.140513 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: action_args: {'id': '612ae9ec-d528-4264-afd3-373c904f50fd'} May 26 15:26:54.141542 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:26:54.141542 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:26:54.141542 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:26:54.141542 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:26:54.141542 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:26:54.141542 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:26:54.141542 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:26:54.141542 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:26:54.141542 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:26:54.141542 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:26:54.141542 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 612ae9ec-d528-4264-afd3-373c904f50fd could not be found. May 26 15:26:54.141542 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:26:54.141542 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:26:54.141542 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:26:54.141542 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:26:54.141542 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:26:54.141542 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:26:54.141542 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:26:54.141542 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:26:54.141542 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:26:54.142928 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:26:54.142928 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 15:26:54.142928 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 15:26:54.142928 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 15:26:54.142928 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 15:26:54.142928 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:26:54.142928 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:26:54.142928 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:26:54.142928 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:26:54.142928 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 612ae9ec-d528-4264-afd3-373c904f50fd could not be found. May 26 15:26:54.142928 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:26:54.142928 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:26:54.142928 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:26:54.142928 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:26:54.142928 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:26:54.142928 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:26:54.142928 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:26:54.142928 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:26:54.142928 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 612ae9ec-d528-4264-afd3-373c904f50fd could not be found. May 26 15:26:54.142928 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:26:54.144443 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-45893dd5-0939-4289-85f1-6e64026b6227 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Returning 404 to user: Instance 612ae9ec-d528-4264-afd3-373c904f50fd could not be found. {{(pid=117799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:26:54.144443 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-45893dd5-0939-4289-85f1-6e64026b6227 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "DELETE /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd" status: 404 len: 111 microversion: 2.1 time: 0.032513 May 26 15:26:54.144443 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 625/1221] 10.222.0.45 () {58 vars in 1238 bytes} [Thu May 26 15:26:54 2022] DELETE /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:26:54.148928 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ccc4688d-ed6d-4cf2-8ed2-ef2c168216fa tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:26:54.149535 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ccc4688d-ed6d-4cf2-8ed2-ef2c168216fa tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] [instance: 612ae9ec-d528-4264-afd3-373c904f50fd] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:26:54.155513 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ccc4688d-ed6d-4cf2-8ed2-ef2c168216fa tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:54.155954 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ccc4688d-ed6d-4cf2-8ed2-ef2c168216fa tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:54.156709 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ccc4688d-ed6d-4cf2-8ed2-ef2c168216fa tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:26:54.157138 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ccc4688d-ed6d-4cf2-8ed2-ef2c168216fa tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:26:54.170461 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.wsgi [None req-ccc4688d-ed6d-4cf2-8ed2-ef2c168216fa tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] HTTP exception thrown: Instance 612ae9ec-d528-4264-afd3-373c904f50fd could not be found. May 26 15:26:54.172055 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ccc4688d-ed6d-4cf2-8ed2-ef2c168216fa tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Request method failure captured: May 26 15:26:54.172055 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: request: GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd HTTP/1.1 May 26 15:26:54.172055 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept: application/json May 26 15:26:54.172055 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Accept-Encoding: identity May 26 15:26:54.172055 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Connection: close May 26 15:26:54.172055 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Length: 0 May 26 15:26:54.172055 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Content-Type: application/json May 26 15:26:54.172055 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Host: 10.222.0.45 May 26 15:26:54.172055 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Openstack-System-Scope: None May 26 15:26:54.172055 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: User-Agent: python-urllib3/1.26.9 May 26 15:26:54.172055 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Auth-Token: gAAAAABij5nexOfvx9HOyJdMFv0iYw26G55P0mcIJ964qVRlBpnl5dDkcp5teDBUHs1fAiDyrF3SCEhLZfW8wetD5OqfpnRwTYGwKNFfkkYJ5jLmXcaV-DxhyVIa0__cD3b3mLD86YOWSidiK3Rp0MY0Do-Ig3pSvtmTqKtdOWnzn_eFIrSO7Dw May 26 15:26:54.172055 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Id: None May 26 15:26:54.172055 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Domain-Name: None May 26 15:26:54.172055 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Identity-Status: Confirmed May 26 15:26:54.172055 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Is-Admin-Project: True May 26 15:26:54.172055 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Id: default May 26 15:26:54.172055 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Domain-Name: Default May 26 15:26:54.172055 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Id: 1da6b127a0d64f8892c4935ef08ed679 May 26 15:26:54.172055 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Project-Name: tempest-TestVolumeBootPattern-1530978248 May 26 15:26:54.172055 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Role: reader,member May 26 15:26:54.172055 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Roles: reader,member May 26 15:26:54.173750 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1da6b127a0d64f8892c4935ef08ed679"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1da6b127a0d64f8892c4935ef08ed679"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1da6b127a0d64f8892c4935ef08ed679"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1da6b127a0d64f8892c4935ef08ed679"}]}] May 26 15:26:54.173750 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant: tempest-TestVolumeBootPattern-1530978248 May 26 15:26:54.173750 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Id: 1da6b127a0d64f8892c4935ef08ed679 May 26 15:26:54.173750 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-Tenant-Name: tempest-TestVolumeBootPattern-1530978248 May 26 15:26:54.173750 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User: tempest-TestVolumeBootPattern-1530978248-project May 26 15:26:54.173750 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Id: default May 26 15:26:54.173750 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Domain-Name: Default May 26 15:26:54.173750 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Id: e55884035fd3441583ece37dd8eb9248 May 26 15:26:54.173750 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: X-User-Name: tempest-TestVolumeBootPattern-1530978248-project May 26 15:26:54.173750 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: method: > May 26 15:26:54.173750 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: exception: Instance 612ae9ec-d528-4264-afd3-373c904f50fd could not be found. May 26 15:26:54.173750 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: action_args: {'id': '612ae9ec-d528-4264-afd3-373c904f50fd'} May 26 15:26:54.174892 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:26:54.174892 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:26:54.174892 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:26:54.174892 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:26:54.174892 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:26:54.174892 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:26:54.174892 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:26:54.174892 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:26:54.174892 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:26:54.174892 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:26:54.174892 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 612ae9ec-d528-4264-afd3-373c904f50fd could not be found. May 26 15:26:54.174892 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:26:54.174892 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:26:54.174892 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:26:54.174892 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:26:54.174892 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:26:54.174892 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:26:54.174892 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:26:54.174892 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:26:54.174892 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:26:54.176578 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:26:54.176578 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:26:54.176578 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:26:54.176578 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:26:54.176578 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:26:54.176578 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:26:54.176578 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:26:54.176578 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 612ae9ec-d528-4264-afd3-373c904f50fd could not be found. May 26 15:26:54.176578 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:26:54.176578 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:26:54.176578 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:26:54.176578 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:26:54.176578 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:26:54.176578 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:26:54.176578 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:26:54.176578 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:26:54.176578 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 612ae9ec-d528-4264-afd3-373c904f50fd could not be found. May 26 15:26:54.176578 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: ERROR nova.api.openstack.wsgi May 26 15:26:54.178678 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ccc4688d-ed6d-4cf2-8ed2-ef2c168216fa tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Returning 404 to user: Instance 612ae9ec-d528-4264-afd3-373c904f50fd could not be found. {{(pid=117798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:26:54.178678 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ccc4688d-ed6d-4cf2-8ed2-ef2c168216fa tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd" status: 404 len: 111 microversion: 2.1 time: 0.028407 May 26 15:26:54.178678 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 597/1222] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:26:54 2022] GET /compute/v2.1/servers/612ae9ec-d528-4264-afd3-373c904f50fd => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:26:55.468819 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-dd0dc7d6-6f2b-4bd9-9d03-09e3105e0d94 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] Calling method '.version_select at 0x7ffb5f3238b0>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:26:55.491798 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-dd0dc7d6-6f2b-4bd9-9d03-09e3105e0d94 tempest-TestVolumeBootPattern-1530978248 tempest-TestVolumeBootPattern-1530978248-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1181214903" status: 202 len: 0 microversion: 2.1 time: 0.026731 May 26 15:26:55.492646 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 626/1223] 10.222.0.45 () {58 vars in 1262 bytes} [Thu May 26 15:26:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1181214903 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:26:56.476069 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:26:56.476662 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Thu May 26 15:26:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 15:27:18.976166 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-cd03bb14-cc56-4913-aa77-4b4e6a7770d8 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-20606018"}} {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:27:18.976864 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-cd03bb14-cc56-4913-aa77-4b4e6a7770d8 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:27:18.978926 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=2 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:27:18.979697 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG dbcounter [-] [117798] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:27:18.985791 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cd03bb14-cc56-4913-aa77-4b4e6a7770d8 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:27:18.986238 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cd03bb14-cc56-4913-aa77-4b4e6a7770d8 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:27:18.987002 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cd03bb14-cc56-4913-aa77-4b4e6a7770d8 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:27:18.987489 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-cd03bb14-cc56-4913-aa77-4b4e6a7770d8 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:27:19.118355 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.network.security_group_api [None req-cd03bb14-cc56-4913-aa77-4b4e6a7770d8 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Removing security group 83b6915f-3fbf-426b-a233-5f25cf3571ce from port 1c375646-f237-4900-866d-7a3da3589b33 May 26 15:27:19.485920 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-cd03bb14-cc56-4913-aa77-4b4e6a7770d8 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "POST /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae/action" status: 202 len: 0 microversion: 2.1 time: 0.513275 May 26 15:27:19.490734 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_cell1:SELECT=32 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:27:19.491663 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG dbcounter [-] [117799] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=117799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:27:19.492391 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 598/1224] 10.222.0.45 () {60 vars in 1277 bytes} [Thu May 26 15:27:18 2022] POST /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae/action => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:27:19.495968 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-7ec8a325-6559-4cc7-b5ed-426276311214 req-14f56fd1-851a-4715-98d8-24c00a8542d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "974b6652-5d82-41a1-be5d-9a3adc0f7cae", "tag": "1c375646-f237-4900-866d-7a3da3589b33"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:27:19.521023 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-7ec8a325-6559-4cc7-b5ed-426276311214 req-14f56fd1-851a-4715-98d8-24c00a8542d9 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:27:19.521790 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-7ec8a325-6559-4cc7-b5ed-426276311214 req-14f56fd1-851a-4715-98d8-24c00a8542d9 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:27:19.537312 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-7ec8a325-6559-4cc7-b5ed-426276311214 req-14f56fd1-851a-4715-98d8-24c00a8542d9 service nova] Creating event network-changed:1c375646-f237-4900-866d-7a3da3589b33 for instance 974b6652-5d82-41a1-be5d-9a3adc0f7cae on hv-cinder-84301 May 26 15:27:19.545637 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-7ec8a325-6559-4cc7-b5ed-426276311214 req-14f56fd1-851a-4715-98d8-24c00a8542d9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056575 May 26 15:27:19.548219 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 627/1225] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:27:21.123693 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-3243fc50-eca5-4332-ad57-57ddf3dc151d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:27:21.124250 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-3243fc50-eca5-4332-ad57-57ddf3dc151d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:27:21.125071 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-1e2b5a13-314f-4742-a844-20b184411de3 req-2979d446-cc86-4d62-aeb4-3e42a94fd33a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "974b6652-5d82-41a1-be5d-9a3adc0f7cae", "tag": "1c375646-f237-4900-866d-7a3da3589b33"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:27:21.131465 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3243fc50-eca5-4332-ad57-57ddf3dc151d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:27:21.131909 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3243fc50-eca5-4332-ad57-57ddf3dc151d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:27:21.132663 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3243fc50-eca5-4332-ad57-57ddf3dc151d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:27:21.133084 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-3243fc50-eca5-4332-ad57-57ddf3dc151d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:27:21.134612 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-1e2b5a13-314f-4742-a844-20b184411de3 req-2979d446-cc86-4d62-aeb4-3e42a94fd33a service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:27:21.135154 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-1e2b5a13-314f-4742-a844-20b184411de3 req-2979d446-cc86-4d62-aeb4-3e42a94fd33a service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:27:21.146967 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-1e2b5a13-314f-4742-a844-20b184411de3 req-2979d446-cc86-4d62-aeb4-3e42a94fd33a service nova] Creating event network-changed:1c375646-f237-4900-866d-7a3da3589b33 for instance 974b6652-5d82-41a1-be5d-9a3adc0f7cae on hv-cinder-84301 May 26 15:27:21.152036 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-1e2b5a13-314f-4742-a844-20b184411de3 req-2979d446-cc86-4d62-aeb4-3e42a94fd33a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031080 May 26 15:27:21.152949 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 628/1226] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:27:21.225571 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.objects.instance [None req-3243fc50-eca5-4332-ad57-57ddf3dc151d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lazy-loading 'services' on Instance uuid 974b6652-5d82-41a1-be5d-9a3adc0f7cae {{(pid=117798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:27:21.308913 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-3243fc50-eca5-4332-ad57-57ddf3dc151d tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "DELETE /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae/os-volume_attachments/14d610e6-392a-4d75-8224-9ac089c4eebc" status: 202 len: 0 microversion: 2.1 time: 0.190427 May 26 15:27:21.309742 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 599/1227] 10.222.0.45 () {58 vars in 1415 bytes} [Thu May 26 15:27:21 2022] DELETE /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae/os-volume_attachments/14d610e6-392a-4d75-8224-9ac089c4eebc => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:27:21.322762 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-b6386f3d-1759-4769-af07-a6f23db4b672 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:27:21.324684 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-b6386f3d-1759-4769-af07-a6f23db4b672 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:27:21.333434 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b6386f3d-1759-4769-af07-a6f23db4b672 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:27:21.334899 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b6386f3d-1759-4769-af07-a6f23db4b672 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:27:21.337750 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b6386f3d-1759-4769-af07-a6f23db4b672 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:27:21.338528 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-b6386f3d-1759-4769-af07-a6f23db4b672 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:27:21.381226 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-b6386f3d-1759-4769-af07-a6f23db4b672 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066303 May 26 15:27:21.382157 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 629/1228] 10.222.0.45 () {58 vars in 1301 bytes} [Thu May 26 15:27:21 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:27:22.393820 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-ee1450b4-36a4-462f-a1d5-4ad54403f10c tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:27:22.394802 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-ee1450b4-36a4-462f-a1d5-4ad54403f10c tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:27:22.401061 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ee1450b4-36a4-462f-a1d5-4ad54403f10c tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:27:22.401496 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ee1450b4-36a4-462f-a1d5-4ad54403f10c tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:27:22.402238 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ee1450b4-36a4-462f-a1d5-4ad54403f10c tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:27:22.402660 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-ee1450b4-36a4-462f-a1d5-4ad54403f10c tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:27:22.430573 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-ee1450b4-36a4-462f-a1d5-4ad54403f10c tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041695 May 26 15:27:22.431135 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 600/1229] 10.222.0.45 () {58 vars in 1301 bytes} [Thu May 26 15:27:22 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 15:27:22.441023 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-0c48901b-fe07-4f46-8a4f-e01753a28ee6 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:27:22.441519 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-0c48901b-fe07-4f46-8a4f-e01753a28ee6 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:27:22.449061 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0c48901b-fe07-4f46-8a4f-e01753a28ee6 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:27:22.449510 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0c48901b-fe07-4f46-8a4f-e01753a28ee6 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:27:22.450290 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0c48901b-fe07-4f46-8a4f-e01753a28ee6 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:27:22.450759 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-0c48901b-fe07-4f46-8a4f-e01753a28ee6 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:27:22.532105 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.wsgi [None req-0c48901b-fe07-4f46-8a4f-e01753a28ee6 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] HTTP exception thrown: Instance 974b6652-5d82-41a1-be5d-9a3adc0f7cae is not attached to volume 14d610e6-392a-4d75-8224-9ac089c4eebc May 26 15:27:22.540939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-0c48901b-fe07-4f46-8a4f-e01753a28ee6 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Request method failure captured: May 26 15:27:22.540939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: request: DELETE /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae/os-volume_attachments/14d610e6-392a-4d75-8224-9ac089c4eebc HTTP/1.1 May 26 15:27:22.540939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept: application/json May 26 15:27:22.540939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept-Encoding: identity May 26 15:27:22.540939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Connection: close May 26 15:27:22.540939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Length: 0 May 26 15:27:22.540939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Type: application/json May 26 15:27:22.540939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Host: 10.222.0.45 May 26 15:27:22.540939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Openstack-System-Scope: None May 26 15:27:22.540939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: User-Agent: python-urllib3/1.26.9 May 26 15:27:22.540939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Auth-Token: gAAAAABij5spBTBBCViVvzu-zuZdizQXgWYOAKBbvT6PLR2lXFsefeAr7Rh64aE_l6bJrZqG-Rqn3m9ekC4gSjoGmdvGMYyQjwDIp_FpewtnuxWfSe-us_5JdB8V_E2rn0x-sYpBqBwyqyiWiPxP9LyUKqPsoj5Tq38zOXBX_89ITzy2nt7h5gc May 26 15:27:22.540939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Id: None May 26 15:27:22.540939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Name: None May 26 15:27:22.540939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Identity-Status: Confirmed May 26 15:27:22.540939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Is-Admin-Project: True May 26 15:27:22.540939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Id: default May 26 15:27:22.540939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Name: Default May 26 15:27:22.540939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Id: 96bf20387ac24af6b192f071460b9056 May 26 15:27:22.540939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Name: tempest-TestMinimumBasicScenario-50036141 May 26 15:27:22.540939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Role: reader,member May 26 15:27:22.540939 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Roles: reader,member May 26 15:27:22.542828 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/96bf20387ac24af6b192f071460b9056"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/96bf20387ac24af6b192f071460b9056"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/96bf20387ac24af6b192f071460b9056"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_96bf20387ac24af6b192f071460b9056"}]}] May 26 15:27:22.542828 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant: tempest-TestMinimumBasicScenario-50036141 May 26 15:27:22.542828 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Id: 96bf20387ac24af6b192f071460b9056 May 26 15:27:22.542828 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Name: tempest-TestMinimumBasicScenario-50036141 May 26 15:27:22.542828 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User: tempest-TestMinimumBasicScenario-50036141-project May 26 15:27:22.542828 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Id: default May 26 15:27:22.542828 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Name: Default May 26 15:27:22.542828 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Id: d836530b3a0c47d287c57ae3915d4371 May 26 15:27:22.542828 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Name: tempest-TestMinimumBasicScenario-50036141-project May 26 15:27:22.542828 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: method: > May 26 15:27:22.542828 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: exception: Instance 974b6652-5d82-41a1-be5d-9a3adc0f7cae is not attached to volume 14d610e6-392a-4d75-8224-9ac089c4eebc May 26 15:27:22.546977 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: action_args: {'server_id': '974b6652-5d82-41a1-be5d-9a3adc0f7cae', 'id': '14d610e6-392a-4d75-8224-9ac089c4eebc'} May 26 15:27:22.546977 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:27:22.546977 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:27:22.546977 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 26 15:27:22.546977 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 26 15:27:22.546977 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 15:27:22.546977 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 15:27:22.546977 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 26 15:27:22.546977 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 26 15:27:22.546977 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 14d610e6-392a-4d75-8224-9ac089c4eebc. May 26 15:27:22.546977 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:27:22.546977 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:27:22.546977 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:27:22.546977 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:27:22.546977 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:27:22.546977 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:27:22.546977 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:27:22.546977 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:27:22.546977 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:27:22.548739 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:27:22.548739 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 26 15:27:22.548739 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 26 15:27:22.548739 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 974b6652-5d82-41a1-be5d-9a3adc0f7cae is not attached to volume 14d610e6-392a-4d75-8224-9ac089c4eebc May 26 15:27:22.548739 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:27:22.548739 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:27:22.548739 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:27:22.548739 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:27:22.548739 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:27:22.548739 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:27:22.548739 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:27:22.548739 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:27:22.548739 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 974b6652-5d82-41a1-be5d-9a3adc0f7cae is not attached to volume 14d610e6-392a-4d75-8224-9ac089c4eebc May 26 15:27:22.548739 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:27:22.548739 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-0c48901b-fe07-4f46-8a4f-e01753a28ee6 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Returning 404 to user: Instance 974b6652-5d82-41a1-be5d-9a3adc0f7cae is not attached to volume 14d610e6-392a-4d75-8224-9ac089c4eebc {{(pid=117799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:27:22.550475 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-0c48901b-fe07-4f46-8a4f-e01753a28ee6 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "DELETE /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae/os-volume_attachments/14d610e6-392a-4d75-8224-9ac089c4eebc" status: 404 len: 154 microversion: 2.1 time: 0.105570 May 26 15:27:22.550475 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 630/1230] 10.222.0.45 () {58 vars in 1415 bytes} [Thu May 26 15:27:22 2022] DELETE /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae/os-volume_attachments/14d610e6-392a-4d75-8224-9ac089c4eebc => generated 154 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:27:23.683743 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-0d69449e-3d07-43e1-8282-81808d7c9fc1 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:27:23.684271 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-0d69449e-3d07-43e1-8282-81808d7c9fc1 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:27:23.690789 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0d69449e-3d07-43e1-8282-81808d7c9fc1 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:27:23.691273 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0d69449e-3d07-43e1-8282-81808d7c9fc1 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:27:23.692039 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0d69449e-3d07-43e1-8282-81808d7c9fc1 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:27:23.692469 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-0d69449e-3d07-43e1-8282-81808d7c9fc1 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:27:23.716912 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-0d69449e-3d07-43e1-8282-81808d7c9fc1 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Going to try to terminate instance {{(pid=117798) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:27:23.792356 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-0d69449e-3d07-43e1-8282-81808d7c9fc1 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "DELETE /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 204 len: 0 microversion: 2.1 time: 0.112090 May 26 15:27:23.792987 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 601/1231] 10.222.0.45 () {58 vars in 1238 bytes} [Thu May 26 15:27:23 2022] DELETE /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:27:24.025331 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-dc3fff06-958a-45df-b0b1-4f3f954bb349 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:27:24.025953 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-dc3fff06-958a-45df-b0b1-4f3f954bb349 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:27:24.033009 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dc3fff06-958a-45df-b0b1-4f3f954bb349 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:27:24.033459 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dc3fff06-958a-45df-b0b1-4f3f954bb349 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:27:24.034230 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dc3fff06-958a-45df-b0b1-4f3f954bb349 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:27:24.034669 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-dc3fff06-958a-45df-b0b1-4f3f954bb349 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:27:24.164784 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.policy [None req-dc3fff06-958a-45df-b0b1-4f3f954bb349 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117799) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:27:24.172548 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-dc3fff06-958a-45df-b0b1-4f3f954bb349 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1554 microversion: 2.1 time: 0.373810 May 26 15:27:24.173115 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 631/1232] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:27:23 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1554 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:27:25.191120 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-c00ba70e-7974-403d-b7b7-895f627eab5e tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:27:25.192627 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-c00ba70e-7974-403d-b7b7-895f627eab5e tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:27:25.199205 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c00ba70e-7974-403d-b7b7-895f627eab5e tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:27:25.199658 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c00ba70e-7974-403d-b7b7-895f627eab5e tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:27:25.200427 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c00ba70e-7974-403d-b7b7-895f627eab5e tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:27:25.200860 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-c00ba70e-7974-403d-b7b7-895f627eab5e tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:27:25.332287 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-c00ba70e-7974-403d-b7b7-895f627eab5e tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:27:25.339805 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-c00ba70e-7974-403d-b7b7-895f627eab5e tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1554 microversion: 2.1 time: 0.152898 May 26 15:27:25.340375 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 602/1233] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:27:25 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:27:26.114156 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [req-0ee7a933-51d8-430d-8039-3fa3a7c3c7b4 req-143a734c-d5d5-4b8a-a4ec-529022e21221 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "974b6652-5d82-41a1-be5d-9a3adc0f7cae", "name": "network-vif-deleted", "tag": "1c375646-f237-4900-866d-7a3da3589b33"}]} {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:27:26.123015 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-0ee7a933-51d8-430d-8039-3fa3a7c3c7b4 req-143a734c-d5d5-4b8a-a4ec-529022e21221 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:27:26.123482 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [req-0ee7a933-51d8-430d-8039-3fa3a7c3c7b4 req-143a734c-d5d5-4b8a-a4ec-529022e21221 service nova] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:27:26.134955 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.compute.server_external_events [req-0ee7a933-51d8-430d-8039-3fa3a7c3c7b4 req-143a734c-d5d5-4b8a-a4ec-529022e21221 service nova] Creating event network-vif-deleted:1c375646-f237-4900-866d-7a3da3589b33 for instance 974b6652-5d82-41a1-be5d-9a3adc0f7cae on hv-cinder-84301 May 26 15:27:26.140755 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [req-0ee7a933-51d8-430d-8039-3fa3a7c3c7b4 req-143a734c-d5d5-4b8a-a4ec-529022e21221 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030372 May 26 15:27:26.141357 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 632/1234] 10.222.0.45 () {64 vars in 1317 bytes} [Thu May 26 15:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:27:26.357476 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-bd791897-dffe-4b38-8d83-49c2dbf778f1 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:27:26.358042 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.compute.api [None req-bd791897-dffe-4b38-8d83-49c2dbf778f1 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117798) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:27:26.364734 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bd791897-dffe-4b38-8d83-49c2dbf778f1 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:27:26.365179 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bd791897-dffe-4b38-8d83-49c2dbf778f1 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:27:26.365949 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bd791897-dffe-4b38-8d83-49c2dbf778f1 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:27:26.366384 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bd791897-dffe-4b38-8d83-49c2dbf778f1 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:27:26.399922 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bd791897-dffe-4b38-8d83-49c2dbf778f1 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:27:26.400367 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG oslo_concurrency.lockutils [None req-bd791897-dffe-4b38-8d83-49c2dbf778f1 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:27:26.400824 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.objects.instance [None req-bd791897-dffe-4b38-8d83-49c2dbf778f1 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lazy-loading 'fault' on Instance uuid 974b6652-5d82-41a1-be5d-9a3adc0f7cae {{(pid=117798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:27:26.444470 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.policy [None req-bd791897-dffe-4b38-8d83-49c2dbf778f1 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836530b3a0c47d287c57ae3915d4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bf20387ac24af6b192f071460b9056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117798) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:27:26.452768 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-bd791897-dffe-4b38-8d83-49c2dbf778f1 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 200 len: 1348 microversion: 2.1 time: 0.099386 May 26 15:27:26.453353 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 603/1235] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:27:26 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 1348 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:27:27.472119 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-7109a9ee-a058-4149-9638-e196075845b3 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '>' {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:27:27.473580 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.compute.api [None req-7109a9ee-a058-4149-9638-e196075845b3 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] [instance: 974b6652-5d82-41a1-be5d-9a3adc0f7cae] Fetching instance by UUID {{(pid=117799) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:27:27.480334 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7109a9ee-a058-4149-9638-e196075845b3 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:27:27.480784 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7109a9ee-a058-4149-9638-e196075845b3 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:27:27.481579 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7109a9ee-a058-4149-9638-e196075845b3 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:27:27.482016 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG oslo_concurrency.lockutils [None req-7109a9ee-a058-4149-9638-e196075845b3 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Lock "adff5b13-26db-46a1-a2eb-c66025319ac2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:27:27.495232 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.wsgi [None req-7109a9ee-a058-4149-9638-e196075845b3 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] HTTP exception thrown: Instance 974b6652-5d82-41a1-be5d-9a3adc0f7cae could not be found. May 26 15:27:27.496878 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-7109a9ee-a058-4149-9638-e196075845b3 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Request method failure captured: May 26 15:27:27.496878 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: request: GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae HTTP/1.1 May 26 15:27:27.496878 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept: application/json May 26 15:27:27.496878 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Accept-Encoding: identity May 26 15:27:27.496878 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Connection: close May 26 15:27:27.496878 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Length: 0 May 26 15:27:27.496878 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Content-Type: application/json May 26 15:27:27.496878 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Host: 10.222.0.45 May 26 15:27:27.496878 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Openstack-System-Scope: None May 26 15:27:27.496878 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: User-Agent: python-urllib3/1.26.9 May 26 15:27:27.496878 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Auth-Token: gAAAAABij5spBTBBCViVvzu-zuZdizQXgWYOAKBbvT6PLR2lXFsefeAr7Rh64aE_l6bJrZqG-Rqn3m9ekC4gSjoGmdvGMYyQjwDIp_FpewtnuxWfSe-us_5JdB8V_E2rn0x-sYpBqBwyqyiWiPxP9LyUKqPsoj5Tq38zOXBX_89ITzy2nt7h5gc May 26 15:27:27.496878 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Id: None May 26 15:27:27.496878 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Domain-Name: None May 26 15:27:27.496878 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Identity-Status: Confirmed May 26 15:27:27.496878 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Is-Admin-Project: True May 26 15:27:27.496878 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Id: default May 26 15:27:27.496878 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Domain-Name: Default May 26 15:27:27.496878 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Id: 96bf20387ac24af6b192f071460b9056 May 26 15:27:27.496878 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Project-Name: tempest-TestMinimumBasicScenario-50036141 May 26 15:27:27.496878 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Role: reader,member May 26 15:27:27.496878 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Roles: reader,member May 26 15:27:27.498411 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/96bf20387ac24af6b192f071460b9056"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/96bf20387ac24af6b192f071460b9056"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/96bf20387ac24af6b192f071460b9056"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_96bf20387ac24af6b192f071460b9056"}]}] May 26 15:27:27.498411 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant: tempest-TestMinimumBasicScenario-50036141 May 26 15:27:27.498411 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Id: 96bf20387ac24af6b192f071460b9056 May 26 15:27:27.498411 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-Tenant-Name: tempest-TestMinimumBasicScenario-50036141 May 26 15:27:27.498411 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User: tempest-TestMinimumBasicScenario-50036141-project May 26 15:27:27.498411 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Id: default May 26 15:27:27.498411 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Domain-Name: Default May 26 15:27:27.498411 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Id: d836530b3a0c47d287c57ae3915d4371 May 26 15:27:27.498411 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: X-User-Name: tempest-TestMinimumBasicScenario-50036141-project May 26 15:27:27.498411 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: method: > May 26 15:27:27.498411 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: exception: Instance 974b6652-5d82-41a1-be5d-9a3adc0f7cae could not be found. May 26 15:27:27.498411 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: action_args: {'id': '974b6652-5d82-41a1-be5d-9a3adc0f7cae'} May 26 15:27:27.499370 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: {{(pid=117799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:27:27.499370 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:27:27.499370 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:27:27.499370 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:27:27.499370 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:27:27.499370 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:27:27.499370 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:27:27.499370 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:27:27.499370 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:27:27.499370 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:27:27.499370 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 974b6652-5d82-41a1-be5d-9a3adc0f7cae could not be found. May 26 15:27:27.499370 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:27:27.499370 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:27:27.499370 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:27:27.499370 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:27:27.499370 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:27:27.499370 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:27:27.499370 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:27:27.499370 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:27:27.499370 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:27:27.501186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:27:27.501186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:27:27.501186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:27:27.501186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:27:27.501186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:27:27.501186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:27:27.501186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:27:27.501186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 974b6652-5d82-41a1-be5d-9a3adc0f7cae could not be found. May 26 15:27:27.501186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:27:27.501186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:27:27.501186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:27:27.501186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:27:27.501186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:27:27.501186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:27:27.501186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:27:27.501186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:27:27.501186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 974b6652-5d82-41a1-be5d-9a3adc0f7cae could not be found. May 26 15:27:27.501186 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: ERROR nova.api.openstack.wsgi May 26 15:27:27.502781 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: DEBUG nova.api.openstack.wsgi [None req-7109a9ee-a058-4149-9638-e196075845b3 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Returning 404 to user: Instance 974b6652-5d82-41a1-be5d-9a3adc0f7cae could not be found. {{(pid=117799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:27:27.502781 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO nova.api.openstack.requestlog [None req-7109a9ee-a058-4149-9638-e196075845b3 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae" status: 404 len: 111 microversion: 2.1 time: 0.031280 May 26 15:27:27.502781 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: [pid: 117799|app: 0|req: 633/1236] 10.222.0.45 () {58 vars in 1235 bytes} [Thu May 26 15:27:27 2022] GET /compute/v2.1/servers/974b6652-5d82-41a1-be5d-9a3adc0f7cae => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:27:27.507411 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: DEBUG nova.api.openstack.wsgi [None req-804d8e09-f1cb-4890-bcf0-2c7aa65cbcc9 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] Calling method '.version_select at 0x7ffb630a8160>' {{(pid=117798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:27:27.530461 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO nova.api.openstack.requestlog [None req-804d8e09-f1cb-4890-bcf0-2c7aa65cbcc9 tempest-TestMinimumBasicScenario-50036141 tempest-TestMinimumBasicScenario-50036141-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-545706640" status: 202 len: 0 microversion: 2.1 time: 0.027156 May 26 15:27:27.531038 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: [pid: 117798|app: 0|req: 604/1237] 10.222.0.45 () {58 vars in 1268 bytes} [Thu May 26 15:27:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-545706640 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:27:31.243046 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:27:31.243643 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Thu May 26 15:27:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 15:28:45.798568 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:28:45.799214 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Thu May 26 15:28:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 15:30:16.490029 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:30:16.490735 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Thu May 26 15:30:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 15:30:43.233150 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:30:43.233846 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Thu May 26 15:30:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 15:30:51.252060 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:30:51.252724 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Thu May 26 15:30:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 15:32:05.806576 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:32:05.807213 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Thu May 26 15:32:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 15:32:17.915499 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:32:17.916180 dv-cinder-843018-3-iscsi devstack@n-api.service[117799]: Thu May 26 15:32:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 15:32:40.124486 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:32:40.124904 dv-cinder-843018-3-iscsi devstack@n-api.service[117798]: Thu May 26 15:32:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!